Aug 14 14:53:48 user nova-compute[73254]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 14 14:53:51 user nova-compute[73254]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73254) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73254) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73254) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 14 14:53:51 user nova-compute[73254]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:53:51 user nova-compute[73254]: INFO nova.virt.driver [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 14 14:53:51 user nova-compute[73254]: INFO nova.compute.provider_config [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] Acquiring lock "singleton_lock" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] Acquired lock "singleton_lock" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] Releasing lock "singleton_lock" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] Full set of CONF: {{(pid=73254) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ******************************************************************************** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] Configuration options gathered from: {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ================================================================================ {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] allow_resize_to_same_host      = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] arq_binding_timeout            = 300 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] backdoor_port                  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] backdoor_socket                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] block_device_allocate_retries  = 300 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] block_device_allocate_retries_interval = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cert                           = self.pem {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute_monitors               = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] config_dir                     = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] config_drive_format            = iso9660 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] config_source                  = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] console_host                   = user {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] control_exchange               = nova {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cpu_allocation_ratio           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] daemon                         = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] debug                          = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] default_access_ip_network_name = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] default_availability_zone      = nova {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] default_ephemeral_format       = ext4 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] default_schedule_zone          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] disk_allocation_ratio          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] enable_new_services            = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] enabled_ssl_apis               = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] flat_injected                  = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] force_config_drive             = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] force_raw_images               = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] graceful_shutdown_timeout      = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] heal_instance_info_cache_interval = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] host                           = user {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] instance_build_timeout         = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] instance_delete_interval       = 300 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] instance_name_template         = instance-%08x {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] instance_usage_audit           = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] instance_usage_audit_period    = month {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] internal_service_availability_zone = internal {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] key                            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] live_migration_retry_count     = 30 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] log_config_append              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] log_dir                        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] log_file                       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] log_options                    = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] log_rotate_interval            = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] log_rotate_interval_type       = days {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] log_rotation_type              = none {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] long_rpc_timeout               = 1800 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] max_concurrent_builds          = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] max_concurrent_live_migrations = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] max_concurrent_snapshots       = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] max_local_block_devices        = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] max_logfile_count              = 30 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] max_logfile_size_mb            = 200 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] maximum_instance_delete_attempts = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] metadata_listen                = 0.0.0.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] metadata_listen_port           = 8775 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] metadata_workers               = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] migrate_max_retries            = -1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] mkisofs_cmd                    = genisoimage {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] my_ip                          = 10.0.0.210 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] network_allocate_retries       = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] osapi_compute_listen_port      = 8774 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] osapi_compute_unique_server_name_scope =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] osapi_compute_workers          = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] password_length                = 12 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] periodic_enable                = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] periodic_fuzzy_delay           = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] pointer_model                  = ps2mouse {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] preallocate_images             = none {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] publish_errors                 = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] pybasedir                      = /opt/stack/nova {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ram_allocation_ratio           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] rate_limit_burst               = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] rate_limit_except_level        = CRITICAL {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] rate_limit_interval            = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] reboot_timeout                 = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] reclaim_instance_interval      = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] record                         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] reimage_timeout_per_gb         = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] report_interval                = 120 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] rescue_timeout                 = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] reserved_host_cpus             = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] reserved_host_disk_mb          = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] reserved_host_memory_mb        = 512 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] reserved_huge_pages            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] resize_confirm_window          = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] resize_fs_using_block_device   = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] resume_guests_state_on_host_boot = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] rpc_response_timeout           = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] run_external_periodic_tasks    = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] running_deleted_instance_action = reap {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] running_deleted_instance_timeout = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler_instance_sync_interval = 120 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_down_time              = 720 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] servicegroup_driver            = db {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] shelved_offload_time           = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] shelved_poll_interval          = 3600 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] shutdown_timeout               = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] source_is_ipv6                 = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ssl_only                       = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] state_path                     = /opt/stack/data/nova {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] sync_power_state_interval      = 600 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] sync_power_state_pool_size     = 1000 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] syslog_log_facility            = LOG_USER {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] tempdir                        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] timeout_nbd                    = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] transport_url                  = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] update_resources_interval      = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] use_cow_images                 = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] use_eventlog                   = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] use_journal                    = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] use_json                       = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] use_rootwrap_daemon            = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] use_stderr                     = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] use_syslog                     = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vcpu_pin_set                   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plugging_is_fatal          = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plugging_timeout           = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] virt_mkfs                      = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] volume_usage_poll_interval     = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] watch_log_file                 = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] web                            = /usr/share/spice-html5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_concurrency.disable_process_locking = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.auth_strategy              = keystone {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.compute_link_prefix        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.dhcp_domain                = novalocal {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.enable_instance_password   = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.glance_link_prefix         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.instance_list_per_project_cells = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.list_records_by_skipping_down_cells = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.local_metadata_per_cell    = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.max_limit                  = 1000 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.metadata_cache_expiration  = 15 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.neutron_default_tenant_id  = default {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.use_forwarded_for          = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.use_neutron_default_nets   = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.vendordata_dynamic_targets = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.vendordata_jsonfile_path   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.backend_argument         = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.config_prefix            = cache.oslo {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.dead_timeout             = 60.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.debug_cache_backend      = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.enable_retry_client      = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.enable_socket_keepalive  = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.enabled                  = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.expiration_time          = 600 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.hashclient_retry_attempts = 2 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.memcache_dead_retry      = 300 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.memcache_password        =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.memcache_sasl_enabled    = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.memcache_username        =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.proxies                  = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.retry_attempts           = 2 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.retry_delay              = 0.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.socket_keepalive_count   = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.socket_keepalive_idle    = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.socket_keepalive_interval = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.tls_allowed_ciphers      = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.tls_cafile               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.tls_certfile             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.tls_enabled              = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cache.tls_keyfile              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.auth_section            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.auth_type               = password {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.cafile                  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.certfile                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.collect_timing          = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.cross_az_attach         = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.debug                   = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.endpoint_template       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.http_retries            = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.insecure                = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.keyfile                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.os_region_name          = RegionOne {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.split_loggers           = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cinder.timeout                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.cpu_dedicated_set      = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.cpu_shared_set         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.image_type_exclude_list = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.resource_provider_association_refresh = 300 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.shutdown_retry_interval = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] conductor.workers              = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] console.allowed_origins        = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] console.ssl_ciphers            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] console.ssl_minimum_version    = default {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] consoleauth.token_ttl          = 600 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.cafile                  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.certfile                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.collect_timing          = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.connect_retries         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.connect_retry_delay     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.endpoint_override       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.insecure                = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.keyfile                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.max_version             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.min_version             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.region_name             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.service_name            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.service_type            = accelerator {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.split_loggers           = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:51 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.status_code_retries     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.status_code_retry_delay = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.timeout                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] cyborg.version                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.backend               = sqlalchemy {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.connection            = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.connection_debug      = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.connection_parameters =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.connection_recycle_time = 3600 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.connection_trace      = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.db_inc_retry_interval = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.db_max_retries        = 20 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.db_max_retry_interval = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.db_retry_interval     = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.max_overflow          = 50 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.max_pool_size         = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.max_retries           = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.mysql_enable_ndb      = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.mysql_wsrep_sync_wait = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.pool_timeout          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.retry_interval        = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.slave_connection      = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] database.sqlite_synchronous    = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.backend           = sqlalchemy {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.connection        = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.connection_debug  = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.connection_parameters =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.connection_recycle_time = 3600 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.connection_trace  = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.db_inc_retry_interval = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.db_max_retries    = 20 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.db_max_retry_interval = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.db_retry_interval = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.max_overflow      = 50 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.max_pool_size     = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.max_retries       = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.mysql_enable_ndb  = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.pool_timeout      = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.retry_interval    = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.slave_connection  = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] api_database.sqlite_synchronous = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] devices.enabled_mdev_types     = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ephemeral_storage_encryption.enabled = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.api_servers             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.cafile                  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.certfile                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.collect_timing          = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.connect_retries         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.connect_retry_delay     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.debug                   = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.default_trusted_certificate_ids = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.enable_certificate_validation = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.enable_rbd_download     = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.endpoint_override       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.insecure                = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.keyfile                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.max_version             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.min_version             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.num_retries             = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.rbd_ceph_conf           =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.rbd_connect_timeout     = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.rbd_pool                =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.rbd_user                =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.region_name             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.service_name            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.service_type            = image {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.split_loggers           = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.status_code_retries     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.status_code_retry_delay = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.timeout                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.verify_glance_signatures = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] glance.version                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] guestfs.debug                  = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.config_drive_cdrom      = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.config_drive_inject_password = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.enable_remotefx         = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.instances_path_share    =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.limit_cpu_features      = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.use_multipath_io        = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.vswitch_name            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] mks.enabled                    = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] image_cache.manager_interval   = 2400 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] image_cache.precache_concurrency = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] image_cache.remove_unused_base_images = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] image_cache.subdirectory_name  = _base {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.api_max_retries         = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.api_retry_interval      = 2 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.auth_section            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.auth_type               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.cafile                  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.certfile                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.collect_timing          = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.connect_retries         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.connect_retry_delay     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.endpoint_override       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.insecure                = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.keyfile                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.max_version             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.min_version             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.partition_key           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.peer_list               = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.region_name             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.serial_console_state_timeout = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.service_name            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.service_type            = baremetal {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.split_loggers           = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.status_code_retries     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.status_code_retry_delay = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.timeout                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ironic.version                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] key_manager.fixed_key          = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.barbican_api_version  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.barbican_endpoint     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.barbican_endpoint_type = public {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.barbican_region_name  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.cafile                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.certfile              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.collect_timing        = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.insecure              = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.keyfile               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.number_of_retries     = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.retry_delay           = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.send_service_user_token = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.split_loggers         = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.timeout               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.verify_ssl            = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican.verify_ssl_path       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican_service_user.auth_section = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican_service_user.auth_type = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican_service_user.cafile   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican_service_user.certfile = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican_service_user.collect_timing = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican_service_user.insecure = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican_service_user.keyfile  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican_service_user.split_loggers = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] barbican_service_user.timeout  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.approle_role_id          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.approle_secret_id        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.cafile                   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.certfile                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.collect_timing           = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.insecure                 = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.keyfile                  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.kv_mountpoint            = secret {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.kv_version               = 2 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.namespace                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.root_token_id            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.split_loggers            = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.ssl_ca_crt_file          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.timeout                  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.use_ssl                  = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.cafile                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.certfile              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.collect_timing        = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.connect_retries       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.connect_retry_delay   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.endpoint_override     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.insecure              = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.keyfile               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.max_version           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.min_version           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.region_name           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.service_name          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.service_type          = identity {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.split_loggers         = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.status_code_retries   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.status_code_retry_delay = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.timeout               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] keystone.version               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.connection_uri         =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.cpu_mode               = custom {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: WARNING oslo_config.cfg [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.cpu_power_governor_high = performance {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.cpu_power_management   = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.device_detach_attempts = 8 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.device_detach_timeout  = 20 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.disk_cachemodes        = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.disk_prefix            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.enabled_perf_events    = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.file_backed_memory     = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.gid_maps               = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.hw_disk_discard        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.hw_machine_type        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.images_rbd_pool        = rbd {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.images_type            = default {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.images_volume_group    = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.inject_key             = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.inject_partition       = -2 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.inject_password        = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.iscsi_iface            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.iser_use_multipath     = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_downtime = 500 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_inbound_addr = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_scheme  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_timeout_action = abort {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_tunnelled = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: WARNING oslo_config.cfg [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 14 14:53:52 user nova-compute[73254]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 14 14:53:52 user nova-compute[73254]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 14 14:53:52 user nova-compute[73254]: and ``live_migration_inbound_addr`` respectively.
Aug 14 14:53:52 user nova-compute[73254]: ).  Its value may be silently ignored in the future.
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.live_migration_with_native_tls = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.max_queues             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.nfs_mount_options      = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.num_pcie_ports         = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.pmem_namespaces        = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.quobyte_client_cfg     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.rbd_secret_uuid        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.rbd_user               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.rescue_image_id        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.rescue_kernel_id       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.rx_queue_size          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.smbfs_mount_options    =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.snapshot_compression   = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.snapshot_image_format  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.sparse_logical_volumes = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.swtpm_enabled          = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.swtpm_group            = tss {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.swtpm_user             = tss {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.sysinfo_serial         = unique {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.tb_cache_size          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.tx_queue_size          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.uid_maps               = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.use_virtio_for_bridges = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.virt_type              = kvm {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.volume_clear           = zero {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.volume_clear_size      = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.volume_use_multipath   = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.vzstorage_cache_path   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.auth_section           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.auth_type              = password {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.cafile                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.certfile               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.collect_timing         = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.connect_retries        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.connect_retry_delay    = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.default_floating_pool  = public {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.endpoint_override      = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.extension_sync_interval = 600 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.http_retries           = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.insecure               = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.keyfile                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.max_version            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.min_version            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.ovs_bridge             = br-int {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.physnets               = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.region_name            = RegionOne {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.service_metadata_proxy = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.service_name           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.service_type           = network {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.split_loggers          = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.status_code_retries    = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.status_code_retry_delay = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.timeout                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] neutron.version                = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] notifications.bdms_in_notifications = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] notifications.default_level    = INFO {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] notifications.notification_format = unversioned {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] notifications.notify_on_state_change = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] pci.alias                      = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] pci.device_spec                = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] pci.report_in_placement        = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.auth_section         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.auth_type            = password {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.cafile               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.certfile             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.collect_timing       = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.connect_retries      = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.connect_retry_delay  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.default_domain_id    = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.default_domain_name  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.domain_id            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.domain_name          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.endpoint_override    = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.insecure             = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.keyfile              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.max_version          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.min_version          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.password             = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.project_domain_id    = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.project_domain_name  = Default {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.project_id           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.project_name         = service {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.region_name          = RegionOne {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.service_name         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.service_type         = placement {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.split_loggers        = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.status_code_retries  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.status_code_retry_delay = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.system_scope         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.timeout              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.trust_id             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.user_domain_id       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.user_domain_name     = Default {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.user_id              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.username             = placement {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] placement.version              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.cores                    = 20 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.count_usage_from_placement = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.injected_file_content_bytes = 10240 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.injected_file_path_length = 255 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.injected_files           = 5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.instances                = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.key_pairs                = 100 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.metadata_items           = 128 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.ram                      = 51200 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.recheck_quota            = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.server_group_members     = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] quota.server_groups            = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] rdp.enabled                    = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.image_metadata_prefilter = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.max_attempts         = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.max_placement_results = 1000 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] scheduler.workers              = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.host_subset_size = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.isolated_hosts = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.isolated_images = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.pci_in_placement = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.track_instance_changes = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] metrics.required               = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] metrics.weight_multiplier      = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] metrics.weight_setting         = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] serial_console.enabled         = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] serial_console.port_range      = 10000:20000 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] serial_console.serialproxy_port = 6083 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_user.auth_section      = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_user.auth_type         = password {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_user.cafile            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_user.certfile          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_user.collect_timing    = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_user.insecure          = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_user.keyfile           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_user.send_service_user_token = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_user.split_loggers     = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] service_user.timeout           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.agent_enabled            = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.enabled                  = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.html5proxy_port          = 6082 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.image_compression        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.jpeg_compression         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.playback_compression     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.server_listen            = 127.0.0.1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.streaming_mode           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] spice.zlib_compression         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] upgrade_levels.baseapi         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] upgrade_levels.cert            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] upgrade_levels.compute         = auto {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] upgrade_levels.conductor       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] upgrade_levels.scheduler       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vendordata_dynamic_auth.cafile = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vendordata_dynamic_auth.certfile = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vendordata_dynamic_auth.insecure = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vendordata_dynamic_auth.timeout = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.api_retry_count         = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.ca_file                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.cache_prefix            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.cluster_name            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.connection_pool_size    = 10 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.console_delay_seconds   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.datastore_regex         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.host_ip                 = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.host_password           = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.host_port               = 443 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.host_username           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.insecure                = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.integration_bridge      = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.maximum_objects         = 100 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.pbm_default_policy      = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.pbm_enabled             = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.pbm_wsdl_location       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.serial_port_proxy_uri   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.serial_port_service_uri = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.task_poll_interval      = 0.5 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.use_linked_clone        = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.vnc_keymap              = en-us {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.vnc_port                = 5900 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vmware.vnc_port_total          = 10000 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vnc.auth_schemes               = ['none'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vnc.enabled                    = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vnc.novncproxy_port            = 6080 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vnc.vencrypt_ca_certs          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vnc.vencrypt_client_cert       = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vnc.vencrypt_client_key        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.disable_rootwrap   = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.enable_numa_live_migration = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.libvirt_disable_apic = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.client_socket_timeout     = 900 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.default_pool_size         = 1000 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.keep_alive                = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.max_header_line           = 16384 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.ssl_ca_file               = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.ssl_cert_file             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.ssl_key_file              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.tcp_keepidle              = 600 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] zvm.ca_file                    = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] zvm.cloud_connector_url        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] zvm.reachable_timeout          = 300 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_policy.enforce_new_defaults = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_policy.enforce_scope      = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_policy.policy_default_rule = default {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.connection_string     = messaging:// {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.enabled               = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.es_doc_type           = notification {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.es_scroll_size        = 10000 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.es_scroll_time        = 2m {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.filter_error_trace    = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.hmac_keys             = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.sentinel_service_name = mymaster {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.socket_timeout        = 0.1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.trace_requests        = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler.trace_sqlalchemy      = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler_jaeger.process_tags   = {} {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler_jaeger.service_name_prefix = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] profiler_otlp.service_name_prefix = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] remote_debug.host              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] remote_debug.port              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_notifications.retry = -1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.auth_section        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.auth_type           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.cafile              = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.certfile            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.collect_timing      = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.connect_retries     = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.connect_retry_delay = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.endpoint_id         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.endpoint_override   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.insecure            = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.keyfile             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.max_version         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.min_version         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.region_name         = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.service_name        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.service_type        = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.split_loggers       = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.status_code_retries = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.status_code_retry_delay = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.timeout             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.valid_interfaces    = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_limit.version             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_reports.file_event_handler = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] oslo_reports.log_dir           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_ovs_privileged.group  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] vif_plug_ovs_privileged.user   = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_ovs.isolate_vif         = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] os_brick.lock_path             = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] privsep_osbrick.capabilities   = [21] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] privsep_osbrick.group          = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] privsep_osbrick.helper_command = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] privsep_osbrick.user           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] nova_sys_admin.group           = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] nova_sys_admin.helper_command  = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] nova_sys_admin.user            = None {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG oslo_service.service [None req-c8723114-c8c7-4bd8-b7e9-8185d4dea6c5 None None] ******************************************************************************** {{(pid=73254) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 14 14:53:52 user nova-compute[73254]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 14 14:53:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Starting native event thread {{(pid=73254) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Starting green dispatch thread {{(pid=73254) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Starting connection event dispatch thread {{(pid=73254) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Connecting to libvirt: qemu:///system {{(pid=73254) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd68be58d90> {{(pid=73254) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 14 14:53:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd68be58d90> {{(pid=73254) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 14 14:53:52 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Connection event '1' reason 'None'
Aug 14 14:53:52 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 14:53:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.mount [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Initialising _HostMountState generation 0 {{(pid=73254) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 14 14:53:59 user nova-compute[73254]: INFO nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Libvirt host capabilities <capabilities>
Aug 14 14:53:59 user nova-compute[73254]:   <host>
Aug 14 14:53:59 user nova-compute[73254]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 14 14:53:59 user nova-compute[73254]:     <cpu>
Aug 14 14:53:59 user nova-compute[73254]:       <arch>x86_64</arch>
Aug 14 14:53:59 user nova-compute[73254]:       <model>IvyBridge-IBRS</model>
Aug 14 14:53:59 user nova-compute[73254]:       <vendor>Intel</vendor>
Aug 14 14:53:59 user nova-compute[73254]:       <microcode version='1070'/>
Aug 14 14:53:59 user nova-compute[73254]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 14 14:53:59 user nova-compute[73254]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='ss'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='vmx'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='pcid'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='osxsave'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='hypervisor'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='arat'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='tsc_adjust'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='md-clear'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='stibp'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='arch-capabilities'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='ssbd'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='invtsc'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='rsba'/>
Aug 14 14:53:59 user nova-compute[73254]:       <feature name='skip-l1dfl-vmentry'/>
Aug 14 14:53:59 user nova-compute[73254]:       <pages unit='KiB' size='4'/>
Aug 14 14:53:59 user nova-compute[73254]:       <pages unit='KiB' size='2048'/>
Aug 14 14:53:59 user nova-compute[73254]:     </cpu>
Aug 14 14:53:59 user nova-compute[73254]:     <power_management>
Aug 14 14:53:59 user nova-compute[73254]:       <suspend_mem/>
Aug 14 14:53:59 user nova-compute[73254]:       <suspend_disk/>
Aug 14 14:53:59 user nova-compute[73254]:       <suspend_hybrid/>
Aug 14 14:53:59 user nova-compute[73254]:     </power_management>
Aug 14 14:53:59 user nova-compute[73254]:     <iommu support='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     <migration_features>
Aug 14 14:53:59 user nova-compute[73254]:       <live/>
Aug 14 14:53:59 user nova-compute[73254]:       <uri_transports>
Aug 14 14:53:59 user nova-compute[73254]:         <uri_transport>tcp</uri_transport>
Aug 14 14:53:59 user nova-compute[73254]:         <uri_transport>rdma</uri_transport>
Aug 14 14:53:59 user nova-compute[73254]:       </uri_transports>
Aug 14 14:53:59 user nova-compute[73254]:     </migration_features>
Aug 14 14:53:59 user nova-compute[73254]:     <topology>
Aug 14 14:53:59 user nova-compute[73254]:       <cells num='2'>
Aug 14 14:53:59 user nova-compute[73254]:         <cell id='0'>
Aug 14 14:53:59 user nova-compute[73254]:           <memory unit='KiB'>8140616</memory>
Aug 14 14:53:59 user nova-compute[73254]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 14 14:53:59 user nova-compute[73254]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 14:53:59 user nova-compute[73254]:           <distances>
Aug 14 14:53:59 user nova-compute[73254]:             <sibling id='0' value='10'/>
Aug 14 14:53:59 user nova-compute[73254]:             <sibling id='1' value='20'/>
Aug 14 14:53:59 user nova-compute[73254]:           </distances>
Aug 14 14:53:59 user nova-compute[73254]:           <cpus num='6'>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 14 14:53:59 user nova-compute[73254]:           </cpus>
Aug 14 14:53:59 user nova-compute[73254]:         </cell>
Aug 14 14:53:59 user nova-compute[73254]:         <cell id='1'>
Aug 14 14:53:59 user nova-compute[73254]:           <memory unit='KiB'>8255068</memory>
Aug 14 14:53:59 user nova-compute[73254]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 14 14:53:59 user nova-compute[73254]:           <pages unit='KiB' size='2048'>0</pages>
Aug 14 14:53:59 user nova-compute[73254]:           <distances>
Aug 14 14:53:59 user nova-compute[73254]:             <sibling id='0' value='20'/>
Aug 14 14:53:59 user nova-compute[73254]:             <sibling id='1' value='10'/>
Aug 14 14:53:59 user nova-compute[73254]:           </distances>
Aug 14 14:53:59 user nova-compute[73254]:           <cpus num='6'>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 14 14:53:59 user nova-compute[73254]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 14 14:53:59 user nova-compute[73254]:           </cpus>
Aug 14 14:53:59 user nova-compute[73254]:         </cell>
Aug 14 14:53:59 user nova-compute[73254]:       </cells>
Aug 14 14:53:59 user nova-compute[73254]:     </topology>
Aug 14 14:53:59 user nova-compute[73254]:     <cache>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 14 14:53:59 user nova-compute[73254]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 14 14:53:59 user nova-compute[73254]:     </cache>
Aug 14 14:53:59 user nova-compute[73254]:     <secmodel>
Aug 14 14:53:59 user nova-compute[73254]:       <model>apparmor</model>
Aug 14 14:53:59 user nova-compute[73254]:       <doi>0</doi>
Aug 14 14:53:59 user nova-compute[73254]:     </secmodel>
Aug 14 14:53:59 user nova-compute[73254]:     <secmodel>
Aug 14 14:53:59 user nova-compute[73254]:       <model>dac</model>
Aug 14 14:53:59 user nova-compute[73254]:       <doi>0</doi>
Aug 14 14:53:59 user nova-compute[73254]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 14 14:53:59 user nova-compute[73254]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 14 14:53:59 user nova-compute[73254]:     </secmodel>
Aug 14 14:53:59 user nova-compute[73254]:   </host>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='alpha'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>clipper</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='armv6l'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>spitz</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>nuri</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>kzm</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sx1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>z2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>tosa</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>n810</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>n800</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>terrier</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>midway</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>microbit</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>verdex</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>highbank</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>akita</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>connex</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>collie</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='armv7l'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>spitz</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>nuri</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>kzm</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sx1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>z2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>tosa</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>n810</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>n800</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>terrier</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>midway</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>microbit</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>verdex</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>highbank</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>akita</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>connex</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>collie</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='aarch64'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>integratorcp</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>borzoi</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>spitz</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>nuri</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>musca-b1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>versatileab</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>kzm</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>musca-a</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>smdkc210</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sx1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>z2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>tosa</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>sabrelite</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>realview-eb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>n810</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>n800</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>versatilepb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>terrier</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mainstone</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>midway</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>musicpal</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>microbit</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>cubieboard</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>verdex</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>netduino2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>raspi3b</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>raspi2b</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>cheetah</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>highbank</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>akita</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>connex</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>collie</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>raspi0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <acpi default='on' toggle='yes'/>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='cris'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='i686'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>isapc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>microvm</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='kvm'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <pae/>
Aug 14 14:53:59 user nova-compute[73254]:       <nonpae/>
Aug 14 14:53:59 user nova-compute[73254]:       <acpi default='on' toggle='yes'/>
Aug 14 14:53:59 user nova-compute[73254]:       <apic default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='m68k'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>an5206</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>q800</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>next-cube</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='microblaze'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='microblazeel'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='mips'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='16'>malta</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='mipsel'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='16'>malta</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='mips64'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='16'>malta</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>pica61</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>magnum</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='mips64el'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='16'>malta</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mipssim</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>pica61</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>magnum</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='16'>boston</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='ppc'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mac99</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>40p</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>taihu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='ppc64'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>taihu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>40p</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mac99</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='ppc64le'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2048'>powernv9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>taihu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2048'>powernv10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>ppce500</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>40p</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>pegasos2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>bamboo</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>g3beige</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>mac99</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sam460ex</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>ref405ep</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2048'>powernv8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='riscv32'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='8'>spike</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>opentitan</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='8'>virt</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='riscv64'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='8'>spike</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='5'>sifive_u</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>shakti_c</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sifive_e</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='8'>virt</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='s390x'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='sh4'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>shix</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>r2d</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='sh4eb'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>shix</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>r2d</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='sparc'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>SS-5</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>SS-20</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>LX</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>SS-4</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>SS-10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>Voyager</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='sparc64'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sun4u</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>niagara</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>sun4v</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='x86_64'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>64</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>x-remote</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='1'>isapc</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>microvm</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='kvm'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <acpi default='on' toggle='yes'/>
Aug 14 14:53:59 user nova-compute[73254]:       <apic default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='xtensa'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>sim</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>kc705</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>ml605</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>virt</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>lx200</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>lx60</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]:   <guest>
Aug 14 14:53:59 user nova-compute[73254]:     <os_type>hvm</os_type>
Aug 14 14:53:59 user nova-compute[73254]:     <arch name='xtensaeb'>
Aug 14 14:53:59 user nova-compute[73254]:       <wordsize>32</wordsize>
Aug 14 14:53:59 user nova-compute[73254]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='4'>sim</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>kc705</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>ml605</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>virt</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>lx200</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>lx60</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 14 14:53:59 user nova-compute[73254]:       <domain type='qemu'/>
Aug 14 14:53:59 user nova-compute[73254]:     </arch>
Aug 14 14:53:59 user nova-compute[73254]:     <features>
Aug 14 14:53:59 user nova-compute[73254]:       <cpuselection/>
Aug 14 14:53:59 user nova-compute[73254]:       <deviceboot/>
Aug 14 14:53:59 user nova-compute[73254]:       <disksnapshot default='on' toggle='no'/>
Aug 14 14:53:59 user nova-compute[73254]:     </features>
Aug 14 14:53:59 user nova-compute[73254]:   </guest>
Aug 14 14:53:59 user nova-compute[73254]: </capabilities>
Aug 14 14:53:59 user nova-compute[73254]: 
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:53:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 14 14:54:00 user nova-compute[73254]: <domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 14:54:00 user nova-compute[73254]:   <domain>kvm</domain>
Aug 14 14:54:00 user nova-compute[73254]:   <machine>pc-q35-6.2</machine>
Aug 14 14:54:00 user nova-compute[73254]:   <arch>i686</arch>
Aug 14 14:54:00 user nova-compute[73254]:   <vcpu max='288'/>
Aug 14 14:54:00 user nova-compute[73254]:   <iothreads supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:   <os supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='firmware'/>
Aug 14 14:54:00 user nova-compute[73254]:     <loader supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>rom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pflash</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='readonly'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>yes</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='secure'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </loader>
Aug 14 14:54:00 user nova-compute[73254]:   </os>
Aug 14 14:54:00 user nova-compute[73254]:   <cpu>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-passthrough' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='hostPassthroughMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='maximum' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='maximumMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-model' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <vendor>Intel</vendor>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ss'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='vmx'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pcid'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='hypervisor'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arat'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='umip'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='md-clear'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibpb'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibrs'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='erms'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='lm'/>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='custom' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>qemu64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>qemu32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>phenom</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>n270</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>kvm64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>coreduo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>core2duo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>athlon</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Westmere</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Snowridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Penryn</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G5</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G4</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G1</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Nehalem</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Rome</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Milan</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Dhyana</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cooperlake</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Conroe</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>486</model>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:   </cpu>
Aug 14 14:54:00 user nova-compute[73254]:   <memoryBacking supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='sourceType'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>file</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>anonymous</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>memfd</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:   </memoryBacking>
Aug 14 14:54:00 user nova-compute[73254]:   <devices>
Aug 14 14:54:00 user nova-compute[73254]:     <disk supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='diskDevice'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>disk</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cdrom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>floppy</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>lun</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='bus'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>fdc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sata</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </disk>
Aug 14 14:54:00 user nova-compute[73254]:     <graphics supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sdl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vnc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>spice</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egl-headless</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </graphics>
Aug 14 14:54:00 user nova-compute[73254]:     <video supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='modelType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cirrus</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vmvga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>qxl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>none</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>bochs</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ramfb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </video>
Aug 14 14:54:00 user nova-compute[73254]:     <hostdev supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='mode'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>subsystem</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='startupPolicy'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>default</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>mandatory</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>requisite</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>optional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='subsysType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pci</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='capsType'/>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='pciBackend'/>
Aug 14 14:54:00 user nova-compute[73254]:     </hostdev>
Aug 14 14:54:00 user nova-compute[73254]:     <rng supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>random</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egd</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>builtin</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </rng>
Aug 14 14:54:00 user nova-compute[73254]:     <filesystem supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='driverType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>path</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>handle</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtiofs</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </filesystem>
Aug 14 14:54:00 user nova-compute[73254]:     <tpm supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-tis</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-crb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>passthrough</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>emulator</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </tpm>
Aug 14 14:54:00 user nova-compute[73254]:   </devices>
Aug 14 14:54:00 user nova-compute[73254]:   <features>
Aug 14 14:54:00 user nova-compute[73254]:     <gic supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:     <vmcoreinfo supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <genid supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backingStoreInput supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backup supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <sev supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:   </features>
Aug 14 14:54:00 user nova-compute[73254]: </domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:  {{(pid=73254) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 14 14:54:00 user nova-compute[73254]: <domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 14:54:00 user nova-compute[73254]:   <domain>kvm</domain>
Aug 14 14:54:00 user nova-compute[73254]:   <machine>pc-i440fx-6.2</machine>
Aug 14 14:54:00 user nova-compute[73254]:   <arch>i686</arch>
Aug 14 14:54:00 user nova-compute[73254]:   <vcpu max='255'/>
Aug 14 14:54:00 user nova-compute[73254]:   <iothreads supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:   <os supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='firmware'/>
Aug 14 14:54:00 user nova-compute[73254]:     <loader supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>rom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pflash</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='readonly'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>yes</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='secure'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </loader>
Aug 14 14:54:00 user nova-compute[73254]:   </os>
Aug 14 14:54:00 user nova-compute[73254]:   <cpu>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-passthrough' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='hostPassthroughMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='maximum' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='maximumMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-model' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <vendor>Intel</vendor>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ss'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='vmx'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pcid'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='hypervisor'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arat'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='umip'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='md-clear'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibpb'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibrs'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='erms'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='lm'/>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='custom' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>qemu64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>qemu32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>phenom</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>n270</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>kvm64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>coreduo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>core2duo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>athlon</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Westmere</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Snowridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Penryn</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G5</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G4</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G1</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Nehalem</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Rome</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Milan</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Dhyana</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cooperlake</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Conroe</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>486</model>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:   </cpu>
Aug 14 14:54:00 user nova-compute[73254]:   <memoryBacking supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='sourceType'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>file</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>anonymous</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>memfd</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:   </memoryBacking>
Aug 14 14:54:00 user nova-compute[73254]:   <devices>
Aug 14 14:54:00 user nova-compute[73254]:     <disk supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='diskDevice'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>disk</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cdrom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>floppy</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>lun</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='bus'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ide</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>fdc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sata</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </disk>
Aug 14 14:54:00 user nova-compute[73254]:     <graphics supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sdl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vnc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>spice</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egl-headless</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </graphics>
Aug 14 14:54:00 user nova-compute[73254]:     <video supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='modelType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cirrus</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vmvga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>qxl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>none</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>bochs</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ramfb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </video>
Aug 14 14:54:00 user nova-compute[73254]:     <hostdev supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='mode'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>subsystem</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='startupPolicy'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>default</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>mandatory</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>requisite</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>optional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='subsysType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pci</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='capsType'/>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='pciBackend'/>
Aug 14 14:54:00 user nova-compute[73254]:     </hostdev>
Aug 14 14:54:00 user nova-compute[73254]:     <rng supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>random</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egd</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>builtin</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </rng>
Aug 14 14:54:00 user nova-compute[73254]:     <filesystem supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='driverType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>path</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>handle</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtiofs</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </filesystem>
Aug 14 14:54:00 user nova-compute[73254]:     <tpm supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-tis</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-crb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>passthrough</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>emulator</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </tpm>
Aug 14 14:54:00 user nova-compute[73254]:   </devices>
Aug 14 14:54:00 user nova-compute[73254]:   <features>
Aug 14 14:54:00 user nova-compute[73254]:     <gic supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:     <vmcoreinfo supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <genid supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backingStoreInput supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backup supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <sev supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:   </features>
Aug 14 14:54:00 user nova-compute[73254]: </domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:  {{(pid=73254) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 14 14:54:00 user nova-compute[73254]: <domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 14:54:00 user nova-compute[73254]:   <domain>kvm</domain>
Aug 14 14:54:00 user nova-compute[73254]:   <machine>pc-i440fx-jammy</machine>
Aug 14 14:54:00 user nova-compute[73254]:   <arch>i686</arch>
Aug 14 14:54:00 user nova-compute[73254]:   <vcpu max='255'/>
Aug 14 14:54:00 user nova-compute[73254]:   <iothreads supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:   <os supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='firmware'/>
Aug 14 14:54:00 user nova-compute[73254]:     <loader supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>rom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pflash</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='readonly'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>yes</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='secure'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </loader>
Aug 14 14:54:00 user nova-compute[73254]:   </os>
Aug 14 14:54:00 user nova-compute[73254]:   <cpu>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-passthrough' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='hostPassthroughMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='maximum' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='maximumMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-model' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <vendor>Intel</vendor>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ss'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='vmx'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pcid'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='hypervisor'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arat'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='umip'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='md-clear'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibpb'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibrs'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='erms'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='lm'/>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='custom' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>qemu64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>qemu32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>phenom</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>n270</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>kvm64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>coreduo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>core2duo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>athlon</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Westmere</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Snowridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Penryn</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G5</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G4</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G1</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Nehalem</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Rome</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Milan</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Dhyana</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cooperlake</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Conroe</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>486</model>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:   </cpu>
Aug 14 14:54:00 user nova-compute[73254]:   <memoryBacking supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='sourceType'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>file</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>anonymous</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>memfd</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:   </memoryBacking>
Aug 14 14:54:00 user nova-compute[73254]:   <devices>
Aug 14 14:54:00 user nova-compute[73254]:     <disk supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='diskDevice'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>disk</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cdrom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>floppy</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>lun</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='bus'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ide</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>fdc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sata</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </disk>
Aug 14 14:54:00 user nova-compute[73254]:     <graphics supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sdl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vnc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>spice</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egl-headless</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </graphics>
Aug 14 14:54:00 user nova-compute[73254]:     <video supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='modelType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cirrus</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vmvga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>qxl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>none</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>bochs</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ramfb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </video>
Aug 14 14:54:00 user nova-compute[73254]:     <hostdev supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='mode'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>subsystem</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='startupPolicy'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>default</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>mandatory</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>requisite</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>optional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='subsysType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pci</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='capsType'/>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='pciBackend'/>
Aug 14 14:54:00 user nova-compute[73254]:     </hostdev>
Aug 14 14:54:00 user nova-compute[73254]:     <rng supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>random</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egd</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>builtin</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </rng>
Aug 14 14:54:00 user nova-compute[73254]:     <filesystem supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='driverType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>path</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>handle</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtiofs</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </filesystem>
Aug 14 14:54:00 user nova-compute[73254]:     <tpm supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-tis</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-crb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>passthrough</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>emulator</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </tpm>
Aug 14 14:54:00 user nova-compute[73254]:   </devices>
Aug 14 14:54:00 user nova-compute[73254]:   <features>
Aug 14 14:54:00 user nova-compute[73254]:     <gic supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:     <vmcoreinfo supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <genid supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backingStoreInput supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backup supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <sev supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:   </features>
Aug 14 14:54:00 user nova-compute[73254]: </domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:  {{(pid=73254) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 14 14:54:00 user nova-compute[73254]: <domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:   <path>/usr/bin/qemu-system-i386</path>
Aug 14 14:54:00 user nova-compute[73254]:   <domain>kvm</domain>
Aug 14 14:54:00 user nova-compute[73254]:   <machine>pc-q35-jammy</machine>
Aug 14 14:54:00 user nova-compute[73254]:   <arch>i686</arch>
Aug 14 14:54:00 user nova-compute[73254]:   <vcpu max='288'/>
Aug 14 14:54:00 user nova-compute[73254]:   <iothreads supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:   <os supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='firmware'/>
Aug 14 14:54:00 user nova-compute[73254]:     <loader supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>rom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pflash</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='readonly'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>yes</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='secure'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </loader>
Aug 14 14:54:00 user nova-compute[73254]:   </os>
Aug 14 14:54:00 user nova-compute[73254]:   <cpu>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-passthrough' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='hostPassthroughMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='maximum' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='maximumMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-model' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <vendor>Intel</vendor>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ss'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='vmx'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pcid'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='hypervisor'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arat'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='umip'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='md-clear'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibpb'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibrs'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='erms'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='lm'/>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='custom' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>qemu64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>qemu32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>phenom</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>n270</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>kvm64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>coreduo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>core2duo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>athlon</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Westmere-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Westmere</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Snowridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Penryn</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G5</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G4</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G1</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Nehalem-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Nehalem</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Rome</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Milan</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Dhyana</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cooperlake</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Conroe</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>486</model>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:   </cpu>
Aug 14 14:54:00 user nova-compute[73254]:   <memoryBacking supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='sourceType'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>file</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>anonymous</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>memfd</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:   </memoryBacking>
Aug 14 14:54:00 user nova-compute[73254]:   <devices>
Aug 14 14:54:00 user nova-compute[73254]:     <disk supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='diskDevice'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>disk</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cdrom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>floppy</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>lun</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='bus'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>fdc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sata</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </disk>
Aug 14 14:54:00 user nova-compute[73254]:     <graphics supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sdl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vnc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>spice</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egl-headless</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </graphics>
Aug 14 14:54:00 user nova-compute[73254]:     <video supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='modelType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cirrus</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vmvga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>qxl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>none</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>bochs</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ramfb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </video>
Aug 14 14:54:00 user nova-compute[73254]:     <hostdev supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='mode'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>subsystem</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='startupPolicy'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>default</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>mandatory</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>requisite</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>optional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='subsysType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pci</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='capsType'/>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='pciBackend'/>
Aug 14 14:54:00 user nova-compute[73254]:     </hostdev>
Aug 14 14:54:00 user nova-compute[73254]:     <rng supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>random</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egd</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>builtin</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </rng>
Aug 14 14:54:00 user nova-compute[73254]:     <filesystem supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='driverType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>path</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>handle</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtiofs</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </filesystem>
Aug 14 14:54:00 user nova-compute[73254]:     <tpm supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-tis</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-crb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>passthrough</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>emulator</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </tpm>
Aug 14 14:54:00 user nova-compute[73254]:   </devices>
Aug 14 14:54:00 user nova-compute[73254]:   <features>
Aug 14 14:54:00 user nova-compute[73254]:     <gic supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:     <vmcoreinfo supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <genid supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backingStoreInput supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backup supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <sev supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:   </features>
Aug 14 14:54:00 user nova-compute[73254]: </domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:  {{(pid=73254) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu', 'ubuntu-q35'} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 14 14:54:00 user nova-compute[73254]: <domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 14:54:00 user nova-compute[73254]:   <domain>kvm</domain>
Aug 14 14:54:00 user nova-compute[73254]:   <machine>pc-q35-6.2</machine>
Aug 14 14:54:00 user nova-compute[73254]:   <arch>x86_64</arch>
Aug 14 14:54:00 user nova-compute[73254]:   <vcpu max='288'/>
Aug 14 14:54:00 user nova-compute[73254]:   <iothreads supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:   <os supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='firmware'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>efi</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:     <loader supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>rom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pflash</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='readonly'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>yes</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='secure'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>yes</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </loader>
Aug 14 14:54:00 user nova-compute[73254]:   </os>
Aug 14 14:54:00 user nova-compute[73254]:   <cpu>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-passthrough' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='hostPassthroughMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='maximum' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='maximumMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-model' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <vendor>Intel</vendor>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ss'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='vmx'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pcid'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='hypervisor'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arat'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='umip'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='md-clear'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='invtsc'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibpb'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibrs'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='rsba'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='erms'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='custom' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>qemu64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>qemu32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>phenom</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>n270</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>coreduo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>core2duo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>athlon</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Westmere</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Snowridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Penryn</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G5</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G4</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Opteron_G1</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Nehalem</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Rome</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Milan</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Dhyana</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cooperlake</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Conroe</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>486</model>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:   </cpu>
Aug 14 14:54:00 user nova-compute[73254]:   <memoryBacking supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='sourceType'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>file</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>anonymous</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>memfd</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:   </memoryBacking>
Aug 14 14:54:00 user nova-compute[73254]:   <devices>
Aug 14 14:54:00 user nova-compute[73254]:     <disk supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='diskDevice'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>disk</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cdrom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>floppy</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>lun</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='bus'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>fdc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sata</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </disk>
Aug 14 14:54:00 user nova-compute[73254]:     <graphics supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sdl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vnc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>spice</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egl-headless</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </graphics>
Aug 14 14:54:00 user nova-compute[73254]:     <video supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='modelType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cirrus</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vmvga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>qxl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>none</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>bochs</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ramfb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </video>
Aug 14 14:54:00 user nova-compute[73254]:     <hostdev supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='mode'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>subsystem</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='startupPolicy'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>default</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>mandatory</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>requisite</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>optional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='subsysType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pci</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='capsType'/>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='pciBackend'/>
Aug 14 14:54:00 user nova-compute[73254]:     </hostdev>
Aug 14 14:54:00 user nova-compute[73254]:     <rng supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>random</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egd</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>builtin</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </rng>
Aug 14 14:54:00 user nova-compute[73254]:     <filesystem supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='driverType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>path</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>handle</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtiofs</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </filesystem>
Aug 14 14:54:00 user nova-compute[73254]:     <tpm supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-tis</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-crb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>passthrough</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>emulator</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </tpm>
Aug 14 14:54:00 user nova-compute[73254]:   </devices>
Aug 14 14:54:00 user nova-compute[73254]:   <features>
Aug 14 14:54:00 user nova-compute[73254]:     <gic supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:     <vmcoreinfo supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <genid supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backingStoreInput supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backup supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <sev supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:   </features>
Aug 14 14:54:00 user nova-compute[73254]: </domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:  {{(pid=73254) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 14 14:54:00 user nova-compute[73254]: <domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 14:54:00 user nova-compute[73254]:   <domain>kvm</domain>
Aug 14 14:54:00 user nova-compute[73254]:   <machine>pc-i440fx-6.2</machine>
Aug 14 14:54:00 user nova-compute[73254]:   <arch>x86_64</arch>
Aug 14 14:54:00 user nova-compute[73254]:   <vcpu max='255'/>
Aug 14 14:54:00 user nova-compute[73254]:   <iothreads supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:   <os supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='firmware'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>efi</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:     <loader supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>rom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pflash</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='readonly'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>yes</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='secure'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </loader>
Aug 14 14:54:00 user nova-compute[73254]:   </os>
Aug 14 14:54:00 user nova-compute[73254]:   <cpu>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-passthrough' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='hostPassthroughMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='maximum' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='maximumMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-model' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <vendor>Intel</vendor>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ss'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='vmx'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pcid'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='hypervisor'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arat'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='umip'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='md-clear'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='invtsc'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibpb'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibrs'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='rsba'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='erms'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='custom' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>qemu64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>qemu32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>phenom</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>n270</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>coreduo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>core2duo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>athlon</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Westmere</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Snowridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Penryn</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G5</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G4</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Opteron_G1</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Nehalem</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Rome</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Milan</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Dhyana</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cooperlake</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Conroe</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>486</model>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:   </cpu>
Aug 14 14:54:00 user nova-compute[73254]:   <memoryBacking supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='sourceType'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>file</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>anonymous</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>memfd</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:   </memoryBacking>
Aug 14 14:54:00 user nova-compute[73254]:   <devices>
Aug 14 14:54:00 user nova-compute[73254]:     <disk supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='diskDevice'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>disk</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cdrom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>floppy</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>lun</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='bus'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ide</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>fdc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sata</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </disk>
Aug 14 14:54:00 user nova-compute[73254]:     <graphics supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sdl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vnc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>spice</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egl-headless</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </graphics>
Aug 14 14:54:00 user nova-compute[73254]:     <video supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='modelType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cirrus</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vmvga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>qxl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>none</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>bochs</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ramfb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </video>
Aug 14 14:54:00 user nova-compute[73254]:     <hostdev supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='mode'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>subsystem</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='startupPolicy'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>default</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>mandatory</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>requisite</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>optional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='subsysType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pci</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='capsType'/>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='pciBackend'/>
Aug 14 14:54:00 user nova-compute[73254]:     </hostdev>
Aug 14 14:54:00 user nova-compute[73254]:     <rng supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>random</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egd</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>builtin</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </rng>
Aug 14 14:54:00 user nova-compute[73254]:     <filesystem supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='driverType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>path</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>handle</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtiofs</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </filesystem>
Aug 14 14:54:00 user nova-compute[73254]:     <tpm supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-tis</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-crb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>passthrough</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>emulator</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </tpm>
Aug 14 14:54:00 user nova-compute[73254]:   </devices>
Aug 14 14:54:00 user nova-compute[73254]:   <features>
Aug 14 14:54:00 user nova-compute[73254]:     <gic supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:     <vmcoreinfo supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <genid supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backingStoreInput supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backup supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <sev supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:   </features>
Aug 14 14:54:00 user nova-compute[73254]: </domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:  {{(pid=73254) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 14 14:54:00 user nova-compute[73254]: <domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 14:54:00 user nova-compute[73254]:   <domain>kvm</domain>
Aug 14 14:54:00 user nova-compute[73254]:   <machine>pc-i440fx-jammy</machine>
Aug 14 14:54:00 user nova-compute[73254]:   <arch>x86_64</arch>
Aug 14 14:54:00 user nova-compute[73254]:   <vcpu max='255'/>
Aug 14 14:54:00 user nova-compute[73254]:   <iothreads supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:   <os supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='firmware'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>efi</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:     <loader supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>rom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pflash</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='readonly'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>yes</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='secure'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </loader>
Aug 14 14:54:00 user nova-compute[73254]:   </os>
Aug 14 14:54:00 user nova-compute[73254]:   <cpu>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-passthrough' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='hostPassthroughMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='maximum' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='maximumMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-model' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <vendor>Intel</vendor>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ss'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='vmx'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pcid'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='hypervisor'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arat'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='umip'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='md-clear'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='invtsc'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibpb'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibrs'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='rsba'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='erms'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='custom' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>qemu64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>qemu32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>phenom</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>n270</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>coreduo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>core2duo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>athlon</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Westmere</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Snowridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Penryn</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G5</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G4</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Opteron_G1</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Nehalem</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Rome</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Milan</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Dhyana</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cooperlake</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Conroe</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>486</model>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:   </cpu>
Aug 14 14:54:00 user nova-compute[73254]:   <memoryBacking supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='sourceType'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>file</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>anonymous</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>memfd</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:   </memoryBacking>
Aug 14 14:54:00 user nova-compute[73254]:   <devices>
Aug 14 14:54:00 user nova-compute[73254]:     <disk supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='diskDevice'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>disk</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cdrom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>floppy</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>lun</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='bus'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ide</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>fdc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sata</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </disk>
Aug 14 14:54:00 user nova-compute[73254]:     <graphics supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sdl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vnc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>spice</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egl-headless</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </graphics>
Aug 14 14:54:00 user nova-compute[73254]:     <video supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='modelType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cirrus</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vmvga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>qxl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>none</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>bochs</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ramfb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </video>
Aug 14 14:54:00 user nova-compute[73254]:     <hostdev supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='mode'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>subsystem</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='startupPolicy'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>default</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>mandatory</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>requisite</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>optional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='subsysType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pci</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='capsType'/>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='pciBackend'/>
Aug 14 14:54:00 user nova-compute[73254]:     </hostdev>
Aug 14 14:54:00 user nova-compute[73254]:     <rng supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>random</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egd</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>builtin</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </rng>
Aug 14 14:54:00 user nova-compute[73254]:     <filesystem supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='driverType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>path</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>handle</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtiofs</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </filesystem>
Aug 14 14:54:00 user nova-compute[73254]:     <tpm supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-tis</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-crb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>passthrough</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>emulator</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </tpm>
Aug 14 14:54:00 user nova-compute[73254]:   </devices>
Aug 14 14:54:00 user nova-compute[73254]:   <features>
Aug 14 14:54:00 user nova-compute[73254]:     <gic supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:     <vmcoreinfo supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <genid supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backingStoreInput supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backup supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <sev supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:   </features>
Aug 14 14:54:00 user nova-compute[73254]: </domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:  {{(pid=73254) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 14 14:54:00 user nova-compute[73254]: <domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 14 14:54:00 user nova-compute[73254]:   <domain>kvm</domain>
Aug 14 14:54:00 user nova-compute[73254]:   <machine>pc-q35-jammy</machine>
Aug 14 14:54:00 user nova-compute[73254]:   <arch>x86_64</arch>
Aug 14 14:54:00 user nova-compute[73254]:   <vcpu max='288'/>
Aug 14 14:54:00 user nova-compute[73254]:   <iothreads supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:   <os supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='firmware'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>efi</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:     <loader supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>rom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pflash</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='readonly'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>yes</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='secure'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>yes</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>no</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </loader>
Aug 14 14:54:00 user nova-compute[73254]:   </os>
Aug 14 14:54:00 user nova-compute[73254]:   <cpu>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-passthrough' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='hostPassthroughMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='maximum' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='maximumMigratable'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>on</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>off</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='host-model' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <vendor>Intel</vendor>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ss'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='vmx'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pcid'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='hypervisor'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arat'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='tsc_adjust'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='umip'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='md-clear'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='arch-capabilities'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='invtsc'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibpb'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='ibrs'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-stibp'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='amd-ssbd'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='rsba'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='require' name='pschange-mc-no'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='erms'/>
Aug 14 14:54:00 user nova-compute[73254]:       <feature policy='disable' name='xsaveopt'/>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:     <mode name='custom' supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>qemu64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>qemu32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>phenom</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>pentium</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>n270</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm64</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>kvm32</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>coreduo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>core2duo</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>athlon</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Westmere-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Westmere</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Snowridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Skylake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>SandyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Penryn</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G5</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G4</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G3</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Opteron_G2</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Opteron_G1</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Nehalem</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>IvyBridge</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Icelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Haswell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Rome</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-Milan</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC-IBPB</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>EPYC</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Dhyana</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cooperlake</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>Conroe</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Cascadelake-Server</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-noTSX</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell-IBRS</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='no'>Broadwell</model>
Aug 14 14:54:00 user nova-compute[73254]:       <model usable='yes'>486</model>
Aug 14 14:54:00 user nova-compute[73254]:     </mode>
Aug 14 14:54:00 user nova-compute[73254]:   </cpu>
Aug 14 14:54:00 user nova-compute[73254]:   <memoryBacking supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:     <enum name='sourceType'>
Aug 14 14:54:00 user nova-compute[73254]:       <value>file</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>anonymous</value>
Aug 14 14:54:00 user nova-compute[73254]:       <value>memfd</value>
Aug 14 14:54:00 user nova-compute[73254]:     </enum>
Aug 14 14:54:00 user nova-compute[73254]:   </memoryBacking>
Aug 14 14:54:00 user nova-compute[73254]:   <devices>
Aug 14 14:54:00 user nova-compute[73254]:     <disk supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='diskDevice'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>disk</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cdrom</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>floppy</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>lun</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='bus'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>fdc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sata</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </disk>
Aug 14 14:54:00 user nova-compute[73254]:     <graphics supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='type'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>sdl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vnc</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>spice</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egl-headless</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </graphics>
Aug 14 14:54:00 user nova-compute[73254]:     <video supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='modelType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>cirrus</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>vmvga</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>qxl</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>none</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>bochs</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>ramfb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </video>
Aug 14 14:54:00 user nova-compute[73254]:     <hostdev supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='mode'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>subsystem</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='startupPolicy'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>default</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>mandatory</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>requisite</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>optional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='subsysType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>usb</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>pci</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>scsi</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='capsType'/>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='pciBackend'/>
Aug 14 14:54:00 user nova-compute[73254]:     </hostdev>
Aug 14 14:54:00 user nova-compute[73254]:     <rng supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtio-non-transitional</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>random</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>egd</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>builtin</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </rng>
Aug 14 14:54:00 user nova-compute[73254]:     <filesystem supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='driverType'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>path</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>handle</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>virtiofs</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </filesystem>
Aug 14 14:54:00 user nova-compute[73254]:     <tpm supported='yes'>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='model'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-tis</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>tpm-crb</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:       <enum name='backendModel'>
Aug 14 14:54:00 user nova-compute[73254]:         <value>passthrough</value>
Aug 14 14:54:00 user nova-compute[73254]:         <value>emulator</value>
Aug 14 14:54:00 user nova-compute[73254]:       </enum>
Aug 14 14:54:00 user nova-compute[73254]:     </tpm>
Aug 14 14:54:00 user nova-compute[73254]:   </devices>
Aug 14 14:54:00 user nova-compute[73254]:   <features>
Aug 14 14:54:00 user nova-compute[73254]:     <gic supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:     <vmcoreinfo supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <genid supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backingStoreInput supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <backup supported='yes'/>
Aug 14 14:54:00 user nova-compute[73254]:     <sev supported='no'/>
Aug 14 14:54:00 user nova-compute[73254]:   </features>
Aug 14 14:54:00 user nova-compute[73254]: </domainCapabilities>
Aug 14 14:54:00 user nova-compute[73254]:  {{(pid=73254) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73254) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73254) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Checking secure boot support for host arch (x86_64) {{(pid=73254) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 14 14:54:00 user nova-compute[73254]: INFO nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Secure Boot support detected
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] cpu compare xml: <cpu match="exact">
Aug 14 14:54:00 user nova-compute[73254]:   <model>Nehalem</model>
Aug 14 14:54:00 user nova-compute[73254]: </cpu>
Aug 14 14:54:00 user nova-compute[73254]:  {{(pid=73254) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 14 14:54:00 user nova-compute[73254]: INFO nova.virt.node [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Generated node identity 18d9725d-e260-4cf1-bc72-a3b274e87bc7
Aug 14 14:54:00 user nova-compute[73254]: INFO nova.virt.node [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Wrote node identity 18d9725d-e260-4cf1-bc72-a3b274e87bc7 to /opt/stack/data/nova/compute_id
Aug 14 14:54:00 user nova-compute[73254]: WARNING nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Compute nodes ['18d9725d-e260-4cf1-bc72-a3b274e87bc7'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 14 14:54:00 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 14 14:54:00 user nova-compute[73254]: WARNING nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 14 14:54:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:54:00 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:54:00 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:54:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Hypervisor/Node resource view: name=user free_ram=10889MB free_disk=26.257572174072266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:54:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:54:00 user nova-compute[73254]: WARNING nova.compute.resource_tracker [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] No compute node record for user:18d9725d-e260-4cf1-bc72-a3b274e87bc7: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 18d9725d-e260-4cf1-bc72-a3b274e87bc7 could not be found.
Aug 14 14:54:01 user nova-compute[73254]: INFO nova.compute.resource_tracker [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Compute node record created for user:user with uuid: 18d9725d-e260-4cf1-bc72-a3b274e87bc7
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:54:01 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [req-3c573896-3c6e-4fc8-9696-1baf4923f221] Created resource provider record via placement API for resource provider with UUID 18d9725d-e260-4cf1-bc72-a3b274e87bc7 and name user.
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73254) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 14 14:54:01 user nova-compute[73254]: INFO nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] kernel doesn't support AMD SEV
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Libvirt baseline CPU <cpu>
Aug 14 14:54:01 user nova-compute[73254]:   <arch>x86_64</arch>
Aug 14 14:54:01 user nova-compute[73254]:   <model>Nehalem</model>
Aug 14 14:54:01 user nova-compute[73254]:   <vendor>Intel</vendor>
Aug 14 14:54:01 user nova-compute[73254]:   <topology sockets="6" cores="1" threads="1"/>
Aug 14 14:54:01 user nova-compute[73254]: </cpu>
Aug 14 14:54:01 user nova-compute[73254]:  {{(pid=73254) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Updated inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Updating resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 generation from 0 to 1 during operation: update_inventory {{(pid=73254) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Updating resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 generation from 1 to 2 during operation: update_traits {{(pid=73254) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.632s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.service [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Creating RPC server for service compute {{(pid=73254) start /opt/stack/nova/nova/service.py:182}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.service [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Join ServiceGroup membership for this service compute {{(pid=73254) start /opt/stack/nova/nova/service.py:199}}
Aug 14 14:54:01 user nova-compute[73254]: DEBUG nova.servicegroup.drivers.db [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73254) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 14 14:54:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:54:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:54:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:54:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=10270MB free_disk=26.16130828857422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:54:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:54:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:54:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:54:52 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:54:52 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:54:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:54:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:55:52 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:55:52 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:55:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=10191MB free_disk=26.207775115966797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:55:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:55:53 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:55:53 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:55:53 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:55:53 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:55:53 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:55:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:55:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:55:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:55:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:55:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:55:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:56:53 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:56:53 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:56:53 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=10187MB free_disk=25.991596221923828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:56:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.006s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:56:54 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:56:54 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:56:54 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:56:54 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:56:54 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:56:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:56:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:56:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:56:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:56:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:57:54 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:57:55 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:57:55 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:57:55 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=9453MB free_disk=26.014266967773438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:57:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:57:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:57:55 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:57:55 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:57:55 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:57:55 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:57:55 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:57:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:57:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:57:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:57:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:57:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 14:57:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:57:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:57:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "16996b6c-6d6e-4b51-88f3-0ca024e95639" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG nova.compute.manager [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:58:01 user nova-compute[73254]: INFO nova.compute.claims [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Claim successful on node user
Aug 14 14:58:01 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG nova.compute.manager [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG nova.compute.manager [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:58:01 user nova-compute[73254]: DEBUG nova.network.neutron [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:58:02 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:58:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:58:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:58:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:58:02 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Creating image(s)
Aug 14 14:58:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "/opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "/opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "/opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc.part --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:03 user nova-compute[73254]: DEBUG nova.policy [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f6f7c760aea49c5a2914d1dbff90077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3bb025095b443d822303c387f0deca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:58:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc.part --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:03 user nova-compute[73254]: DEBUG nova.virt.images [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] 5e61edbd-805a-4552-b424-f092693ae8cc was qcow2, converting to raw {{(pid=73254) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 14:58:03 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 14:58:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc.part /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc.converted {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc.part /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc.converted" returned: 0 in 0.229s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc.converted --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc.converted --force-share --output=json" returned: 0 in 0.255s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.633s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:03 user nova-compute[73254]: INFO oslo.privsep.daemon [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpgcu0s6vp/privsep.sock']
Aug 14 14:58:03 user sudo[82703]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpgcu0s6vp/privsep.sock
Aug 14 14:58:03 user sudo[82703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 14:58:06 user sudo[82703]: pam_unix(sudo:session): session closed for user root
Aug 14 14:58:06 user nova-compute[73254]: INFO oslo.privsep.daemon [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Spawned new privsep daemon via rootwrap
Aug 14 14:58:06 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 14:58:06 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 14:58:06 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 14 14:58:06 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82708
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG nova.network.neutron [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Successfully created port: c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.174s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.209s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk 1073741824" returned: 0 in 0.050s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.169s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Cannot resize image /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:58:06 user nova-compute[73254]: DEBUG nova.objects.instance [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lazy-loading 'migration_context' on Instance uuid 16996b6c-6d6e-4b51-88f3-0ca024e95639 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:58:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Ensure instance console log exists: /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:58:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Successfully updated port: c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:58:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:58:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquired lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:58:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:10 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:58:10 user nova-compute[73254]: INFO nova.compute.claims [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Claim successful on node user
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-7a5b7c39-28a9-4894-8a2a-883c2f7d68cb req-2a61f2e6-72e0-4d9c-a16a-da1b044d614b service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Received event network-changed-c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-7a5b7c39-28a9-4894-8a2a-883c2f7d68cb req-2a61f2e6-72e0-4d9c-a16a-da1b044d614b service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Refreshing instance network info cache due to event network-changed-c3f17283-3785-4d52-81a1-f8f65da2404d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7a5b7c39-28a9-4894-8a2a-883c2f7d68cb req-2a61f2e6-72e0-4d9c-a16a-da1b044d614b service nova] Acquiring lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:58:11 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:58:11 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Creating image(s)
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "/opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "/opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "/opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.policy [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02901b088217434eb2a8a4f914ac3e18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7efec9b494b419d88e619898e61108c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:58:11 user nova-compute[73254]: INFO nova.compute.claims [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Claim successful on node user
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk 1073741824" returned: 0 in 0.055s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Cannot resize image /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'migration_context' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Ensure instance console log exists: /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Updating instance_info_cache with network_info: [{"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Releasing lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Instance network_info: |[{"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7a5b7c39-28a9-4894-8a2a-883c2f7d68cb req-2a61f2e6-72e0-4d9c-a16a-da1b044d614b service nova] Acquired lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.network.neutron [req-7a5b7c39-28a9-4894-8a2a-883c2f7d68cb req-2a61f2e6-72e0-4d9c-a16a-da1b044d614b service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Refreshing network info cache for port c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Start _get_guest_xml network_info=[{"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:58:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:58:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1553649845',display_name='tempest-ServersNegativeTestJSON-server-1553649845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1553649845',id=1,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd3bb025095b443d822303c387f0deca',ramdisk_id='',reservation_id='r-owtauw04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-868064230',owner_user_name='tempest-ServersNegativeTestJSON-868064230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:02Z,user_data=None,user_id='8f6f7c760aea49c5a2914d1dbff90077',uuid=16996b6c-6d6e-4b51-88f3-0ca024e95639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converting VIF {"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1d:28,bridge_name='br-int',has_traffic_filtering=True,id=c3f17283-3785-4d52-81a1-f8f65da2404d,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f17283-37') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lazy-loading 'pci_devices' on Instance uuid 16996b6c-6d6e-4b51-88f3-0ca024e95639 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:58:12 user nova-compute[73254]:   <uuid>16996b6c-6d6e-4b51-88f3-0ca024e95639</uuid>
Aug 14 14:58:12 user nova-compute[73254]:   <name>instance-00000001</name>
Aug 14 14:58:12 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:58:12 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:58:12 user nova-compute[73254]:   <metadata>
Aug 14 14:58:12 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:58:12 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:58:12 user nova-compute[73254]:       <nova:name>tempest-ServersNegativeTestJSON-server-1553649845</nova:name>
Aug 14 14:58:12 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:58:12</nova:creationTime>
Aug 14 14:58:12 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:58:12 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:58:12 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:58:12 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:58:12 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:58:12 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:58:12 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:58:12 user nova-compute[73254]:       <nova:owner>
Aug 14 14:58:12 user nova-compute[73254]:         <nova:user uuid="8f6f7c760aea49c5a2914d1dbff90077">tempest-ServersNegativeTestJSON-868064230-project-member</nova:user>
Aug 14 14:58:12 user nova-compute[73254]:         <nova:project uuid="fd3bb025095b443d822303c387f0deca">tempest-ServersNegativeTestJSON-868064230</nova:project>
Aug 14 14:58:12 user nova-compute[73254]:       </nova:owner>
Aug 14 14:58:12 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 14:58:12 user nova-compute[73254]:       <nova:ports>
Aug 14 14:58:12 user nova-compute[73254]:         <nova:port uuid="c3f17283-3785-4d52-81a1-f8f65da2404d">
Aug 14 14:58:12 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 14:58:12 user nova-compute[73254]:         </nova:port>
Aug 14 14:58:12 user nova-compute[73254]:       </nova:ports>
Aug 14 14:58:12 user nova-compute[73254]:     </nova:instance>
Aug 14 14:58:12 user nova-compute[73254]:   </metadata>
Aug 14 14:58:12 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:58:12 user nova-compute[73254]:     <system>
Aug 14 14:58:12 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:58:12 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:58:12 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:58:12 user nova-compute[73254]:       <entry name="serial">16996b6c-6d6e-4b51-88f3-0ca024e95639</entry>
Aug 14 14:58:12 user nova-compute[73254]:       <entry name="uuid">16996b6c-6d6e-4b51-88f3-0ca024e95639</entry>
Aug 14 14:58:12 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:58:12 user nova-compute[73254]:     </system>
Aug 14 14:58:12 user nova-compute[73254]:   </sysinfo>
Aug 14 14:58:12 user nova-compute[73254]:   <os>
Aug 14 14:58:12 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:58:12 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:58:12 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:58:12 user nova-compute[73254]:   </os>
Aug 14 14:58:12 user nova-compute[73254]:   <features>
Aug 14 14:58:12 user nova-compute[73254]:     <acpi/>
Aug 14 14:58:12 user nova-compute[73254]:     <apic/>
Aug 14 14:58:12 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:58:12 user nova-compute[73254]:   </features>
Aug 14 14:58:12 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:58:12 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:58:12 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:58:12 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:58:12 user nova-compute[73254]:   </clock>
Aug 14 14:58:12 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:58:12 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:58:12 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:58:12 user nova-compute[73254]:   </cpu>
Aug 14 14:58:12 user nova-compute[73254]:   <devices>
Aug 14 14:58:12 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 14:58:12 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:58:12 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk"/>
Aug 14 14:58:12 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:58:12 user nova-compute[73254]:     </disk>
Aug 14 14:58:12 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:58:12 user nova-compute[73254]:       <mac address="fa:16:3e:a1:1d:28"/>
Aug 14 14:58:12 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:12 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:58:12 user nova-compute[73254]:       <target dev="tapc3f17283-37"/>
Aug 14 14:58:12 user nova-compute[73254]:     </interface>
Aug 14 14:58:12 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:58:12 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/console.log" append="off"/>
Aug 14 14:58:12 user nova-compute[73254]:     </serial>
Aug 14 14:58:12 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:58:12 user nova-compute[73254]:     <video>
Aug 14 14:58:12 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:12 user nova-compute[73254]:     </video>
Aug 14 14:58:12 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:58:12 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:58:12 user nova-compute[73254]:     </rng>
Aug 14 14:58:12 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:58:12 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:58:12 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:58:12 user nova-compute[73254]:     </memballoon>
Aug 14 14:58:12 user nova-compute[73254]:   </devices>
Aug 14 14:58:12 user nova-compute[73254]: </domain>
Aug 14 14:58:12 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1553649845',display_name='tempest-ServersNegativeTestJSON-server-1553649845',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1553649845',id=1,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd3bb025095b443d822303c387f0deca',ramdisk_id='',reservation_id='r-owtauw04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-868064230',owner_user_name='tempest-ServersNegativeTestJSON-868064230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:02Z,user_data=None,user_id='8f6f7c760aea49c5a2914d1dbff90077',uuid=16996b6c-6d6e-4b51-88f3-0ca024e95639,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converting VIF {"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1d:28,bridge_name='br-int',has_traffic_filtering=True,id=c3f17283-3785-4d52-81a1-f8f65da2404d,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f17283-37') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG os_vif [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1d:28,bridge_name='br-int',has_traffic_filtering=True,id=c3f17283-3785-4d52-81a1-f8f65da2404d,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f17283-37') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Created schema index Interface.name {{(pid=73254) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Created schema index Port.name {{(pid=73254) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Created schema index Bridge.name {{(pid=73254) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [POLLOUT] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:58:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Creating image(s)
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "/opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "/opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "/opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG nova.policy [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abc1e49d76ae4690b8ab6b1dd5ec5eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac5a724189545548484fba6d4e0c842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:58:12 user nova-compute[73254]: INFO oslo.privsep.daemon [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpztqtjoop/privsep.sock']
Aug 14 14:58:12 user sudo[82847]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpztqtjoop/privsep.sock
Aug 14 14:58:12 user sudo[82847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.214s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk 1073741824" returned: 0 in 0.045s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.204s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Cannot resize image /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'migration_context' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Ensure instance console log exists: /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Successfully created port: 5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:58:14 user sudo[82847]: pam_unix(sudo:session): session closed for user root
Aug 14 14:58:14 user nova-compute[73254]: INFO oslo.privsep.daemon [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Spawned new privsep daemon via rootwrap
Aug 14 14:58:14 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 14:58:14 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 14:58:14 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 14 14:58:14 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82864
Aug 14 14:58:14 user nova-compute[73254]: DEBUG nova.network.neutron [req-7a5b7c39-28a9-4894-8a2a-883c2f7d68cb req-2a61f2e6-72e0-4d9c-a16a-da1b044d614b service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Updated VIF entry in instance network info cache for port c3f17283-3785-4d52-81a1-f8f65da2404d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:58:14 user nova-compute[73254]: DEBUG nova.network.neutron [req-7a5b7c39-28a9-4894-8a2a-883c2f7d68cb req-2a61f2e6-72e0-4d9c-a16a-da1b044d614b service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Updating instance_info_cache with network_info: [{"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Successfully created port: d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:58:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7a5b7c39-28a9-4894-8a2a-883c2f7d68cb req-2a61f2e6-72e0-4d9c-a16a-da1b044d614b service nova] Releasing lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3f17283-37, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc3f17283-37, col_values=(('external_ids', {'iface-id': 'c3f17283-3785-4d52-81a1-f8f65da2404d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:1d:28', 'vm-uuid': '16996b6c-6d6e-4b51-88f3-0ca024e95639'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:58:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:15 user nova-compute[73254]: INFO os_vif [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:1d:28,bridge_name='br-int',has_traffic_filtering=True,id=c3f17283-3785-4d52-81a1-f8f65da2404d,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f17283-37')
Aug 14 14:58:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:58:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] No VIF found with MAC fa:16:3e:a1:1d:28, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:58:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Successfully updated port: d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:58:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquired lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:58:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-93fb3445-d4d8-4bce-a9b9-f9a49b94cbf0 req-a879c705-42cd-4491-a042-15a5cde6eb1f service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-changed-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-93fb3445-d4d8-4bce-a9b9-f9a49b94cbf0 req-a879c705-42cd-4491-a042-15a5cde6eb1f service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Refreshing instance network info cache due to event network-changed-d61382b4-4de4-4c87-af8d-1e23129c8d9c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:58:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-93fb3445-d4d8-4bce-a9b9-f9a49b94cbf0 req-a879c705-42cd-4491-a042-15a5cde6eb1f service nova] Acquiring lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025098.0971653, 16996b6c-6d6e-4b51-88f3-0ca024e95639 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:18 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] VM Resumed (Lifecycle Event)
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:58:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Instance spawned successfully.
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:18 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025098.1043081, 16996b6c-6d6e-4b51-88f3-0ca024e95639 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:18 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] VM Started (Lifecycle Event)
Aug 14 14:58:18 user nova-compute[73254]: INFO nova.compute.manager [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Took 16.05 seconds to spawn the instance on the hypervisor.
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:18 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating instance_info_cache with network_info: [{"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Releasing lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Instance network_info: |[{"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-93fb3445-d4d8-4bce-a9b9-f9a49b94cbf0 req-a879c705-42cd-4491-a042-15a5cde6eb1f service nova] Acquired lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.network.neutron [req-93fb3445-d4d8-4bce-a9b9-f9a49b94cbf0 req-a879c705-42cd-4491-a042-15a5cde6eb1f service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Refreshing network info cache for port d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Start _get_guest_xml network_info=[{"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:58:18 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:18 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:18 user nova-compute[73254]: INFO nova.compute.manager [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Took 17.05 seconds to build instance.
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-996986071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-996986071',id=3,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE81NCosY+hLSxQaT3YJdECPNmBC8K0IxTMmr5YY07y2f737ryycLfCD8u3aPgJZ2NssoC5w8RqzmFE2YN7aQNTJ2cW7URXqJqd2kVemceJPz7jm7EjYN9xNLeng+fhOiw==',key_name='tempest-keypair-23196029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-72pyg0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01e4cd7e-3fd9-47fe-870e-31fcd457e263,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'pci_devices' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-377d9392-6e63-46a6-9350-7b74c405d805 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.304s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:58:18 user nova-compute[73254]:   <uuid>01e4cd7e-3fd9-47fe-870e-31fcd457e263</uuid>
Aug 14 14:58:18 user nova-compute[73254]:   <name>instance-00000003</name>
Aug 14 14:58:18 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:58:18 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:58:18 user nova-compute[73254]:   <metadata>
Aug 14 14:58:18 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:58:18 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:58:18 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-996986071</nova:name>
Aug 14 14:58:18 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:58:18</nova:creationTime>
Aug 14 14:58:18 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:58:18 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:58:18 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:58:18 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:58:18 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:58:18 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:58:18 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:58:18 user nova-compute[73254]:       <nova:owner>
Aug 14 14:58:18 user nova-compute[73254]:         <nova:user uuid="abc1e49d76ae4690b8ab6b1dd5ec5eae">tempest-AttachVolumeShelveTestJSON-960640486-project-member</nova:user>
Aug 14 14:58:18 user nova-compute[73254]:         <nova:project uuid="3ac5a724189545548484fba6d4e0c842">tempest-AttachVolumeShelveTestJSON-960640486</nova:project>
Aug 14 14:58:18 user nova-compute[73254]:       </nova:owner>
Aug 14 14:58:18 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 14:58:18 user nova-compute[73254]:       <nova:ports>
Aug 14 14:58:18 user nova-compute[73254]:         <nova:port uuid="d61382b4-4de4-4c87-af8d-1e23129c8d9c">
Aug 14 14:58:18 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 14:58:18 user nova-compute[73254]:         </nova:port>
Aug 14 14:58:18 user nova-compute[73254]:       </nova:ports>
Aug 14 14:58:18 user nova-compute[73254]:     </nova:instance>
Aug 14 14:58:18 user nova-compute[73254]:   </metadata>
Aug 14 14:58:18 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:58:18 user nova-compute[73254]:     <system>
Aug 14 14:58:18 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:58:18 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:58:18 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:58:18 user nova-compute[73254]:       <entry name="serial">01e4cd7e-3fd9-47fe-870e-31fcd457e263</entry>
Aug 14 14:58:18 user nova-compute[73254]:       <entry name="uuid">01e4cd7e-3fd9-47fe-870e-31fcd457e263</entry>
Aug 14 14:58:18 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:58:18 user nova-compute[73254]:     </system>
Aug 14 14:58:18 user nova-compute[73254]:   </sysinfo>
Aug 14 14:58:18 user nova-compute[73254]:   <os>
Aug 14 14:58:18 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:58:18 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:58:18 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:58:18 user nova-compute[73254]:   </os>
Aug 14 14:58:18 user nova-compute[73254]:   <features>
Aug 14 14:58:18 user nova-compute[73254]:     <acpi/>
Aug 14 14:58:18 user nova-compute[73254]:     <apic/>
Aug 14 14:58:18 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:58:18 user nova-compute[73254]:   </features>
Aug 14 14:58:18 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:58:18 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:58:18 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:58:18 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:58:18 user nova-compute[73254]:   </clock>
Aug 14 14:58:18 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:58:18 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:58:18 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:58:18 user nova-compute[73254]:   </cpu>
Aug 14 14:58:18 user nova-compute[73254]:   <devices>
Aug 14 14:58:18 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 14:58:18 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:58:18 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk"/>
Aug 14 14:58:18 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:58:18 user nova-compute[73254]:     </disk>
Aug 14 14:58:18 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:58:18 user nova-compute[73254]:       <mac address="fa:16:3e:8d:e3:3d"/>
Aug 14 14:58:18 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:18 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:58:18 user nova-compute[73254]:       <target dev="tapd61382b4-4d"/>
Aug 14 14:58:18 user nova-compute[73254]:     </interface>
Aug 14 14:58:18 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:58:18 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/console.log" append="off"/>
Aug 14 14:58:18 user nova-compute[73254]:     </serial>
Aug 14 14:58:18 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:58:18 user nova-compute[73254]:     <video>
Aug 14 14:58:18 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:18 user nova-compute[73254]:     </video>
Aug 14 14:58:18 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:58:18 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:58:18 user nova-compute[73254]:     </rng>
Aug 14 14:58:18 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:58:18 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:58:18 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:58:18 user nova-compute[73254]:     </memballoon>
Aug 14 14:58:18 user nova-compute[73254]:   </devices>
Aug 14 14:58:18 user nova-compute[73254]: </domain>
Aug 14 14:58:18 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-996986071',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-996986071',id=3,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE81NCosY+hLSxQaT3YJdECPNmBC8K0IxTMmr5YY07y2f737ryycLfCD8u3aPgJZ2NssoC5w8RqzmFE2YN7aQNTJ2cW7URXqJqd2kVemceJPz7jm7EjYN9xNLeng+fhOiw==',key_name='tempest-keypair-23196029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-72pyg0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01e4cd7e-3fd9-47fe-870e-31fcd457e263,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG os_vif [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd61382b4-4d, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd61382b4-4d, col_values=(('external_ids', {'iface-id': 'd61382b4-4de4-4c87-af8d-1e23129c8d9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:e3:3d', 'vm-uuid': '01e4cd7e-3fd9-47fe-870e-31fcd457e263'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:18 user nova-compute[73254]: INFO os_vif [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d')
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] No VIF found with MAC fa:16:3e:8d:e3:3d, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Successfully updated port: 5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquired lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:58:19 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:58:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-636e61bd-b1d2-4e69-b24a-8960bb8cc64a req-d80a2cc1-c7f2-47ff-b96b-7d7c5ef60206 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-changed-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-636e61bd-b1d2-4e69-b24a-8960bb8cc64a req-d80a2cc1-c7f2-47ff-b96b-7d7c5ef60206 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Refreshing instance network info cache due to event network-changed-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:58:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-636e61bd-b1d2-4e69-b24a-8960bb8cc64a req-d80a2cc1-c7f2-47ff-b96b-7d7c5ef60206 service nova] Acquiring lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:19 user nova-compute[73254]: DEBUG nova.network.neutron [req-93fb3445-d4d8-4bce-a9b9-f9a49b94cbf0 req-a879c705-42cd-4491-a042-15a5cde6eb1f service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updated VIF entry in instance network info cache for port d61382b4-4de4-4c87-af8d-1e23129c8d9c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:58:19 user nova-compute[73254]: DEBUG nova.network.neutron [req-93fb3445-d4d8-4bce-a9b9-f9a49b94cbf0 req-a879c705-42cd-4491-a042-15a5cde6eb1f service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating instance_info_cache with network_info: [{"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-93fb3445-d4d8-4bce-a9b9-f9a49b94cbf0 req-a879c705-42cd-4491-a042-15a5cde6eb1f service nova] Releasing lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance_info_cache with network_info: [{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Releasing lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance network_info: |[{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-636e61bd-b1d2-4e69-b24a-8960bb8cc64a req-d80a2cc1-c7f2-47ff-b96b-7d7c5ef60206 service nova] Acquired lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.network.neutron [req-636e61bd-b1d2-4e69-b24a-8960bb8cc64a req-d80a2cc1-c7f2-47ff-b96b-7d7c5ef60206 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Refreshing network info cache for port 5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Start _get_guest_xml network_info=[{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:58:20 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:20 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1755851336',display_name='tempest-ServerActionsTestOtherB-server-1755851336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1755851336',id=2,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpJqshf7dgOYCNb3XdGQKDGpgxinwrIHq7RhTsMWSm+s6EZD5PqStn0mS7XZys0yosnUZjjjacxB+uA7VCgltNQhd/8n8Kmf9j/njpDibTqPOQpZxcFfHs+Tu7LtgV0vQ==',key_name='tempest-keypair-50791975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7efec9b494b419d88e619898e61108c',ramdisk_id='',reservation_id='r-raqid4hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-872428687',owner_user_name='tempest-ServerActionsTestOtherB-872428687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02901b088217434eb2a8a4f914ac3e18',uuid=0110dafc-b336-45bd-aade-0eb9ba632a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converting VIF {"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'pci_devices' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:58:20 user nova-compute[73254]:   <uuid>0110dafc-b336-45bd-aade-0eb9ba632a05</uuid>
Aug 14 14:58:20 user nova-compute[73254]:   <name>instance-00000002</name>
Aug 14 14:58:20 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:58:20 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:58:20 user nova-compute[73254]:   <metadata>
Aug 14 14:58:20 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:58:20 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:58:20 user nova-compute[73254]:       <nova:name>tempest-ServerActionsTestOtherB-server-1755851336</nova:name>
Aug 14 14:58:20 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:58:20</nova:creationTime>
Aug 14 14:58:20 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:58:20 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:58:20 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:58:20 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:58:20 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:58:20 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:58:20 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:58:20 user nova-compute[73254]:       <nova:owner>
Aug 14 14:58:20 user nova-compute[73254]:         <nova:user uuid="02901b088217434eb2a8a4f914ac3e18">tempest-ServerActionsTestOtherB-872428687-project-member</nova:user>
Aug 14 14:58:20 user nova-compute[73254]:         <nova:project uuid="b7efec9b494b419d88e619898e61108c">tempest-ServerActionsTestOtherB-872428687</nova:project>
Aug 14 14:58:20 user nova-compute[73254]:       </nova:owner>
Aug 14 14:58:20 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 14:58:20 user nova-compute[73254]:       <nova:ports>
Aug 14 14:58:20 user nova-compute[73254]:         <nova:port uuid="5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3">
Aug 14 14:58:20 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 14:58:20 user nova-compute[73254]:         </nova:port>
Aug 14 14:58:20 user nova-compute[73254]:       </nova:ports>
Aug 14 14:58:20 user nova-compute[73254]:     </nova:instance>
Aug 14 14:58:20 user nova-compute[73254]:   </metadata>
Aug 14 14:58:20 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:58:20 user nova-compute[73254]:     <system>
Aug 14 14:58:20 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:58:20 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:58:20 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:58:20 user nova-compute[73254]:       <entry name="serial">0110dafc-b336-45bd-aade-0eb9ba632a05</entry>
Aug 14 14:58:20 user nova-compute[73254]:       <entry name="uuid">0110dafc-b336-45bd-aade-0eb9ba632a05</entry>
Aug 14 14:58:20 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:58:20 user nova-compute[73254]:     </system>
Aug 14 14:58:20 user nova-compute[73254]:   </sysinfo>
Aug 14 14:58:20 user nova-compute[73254]:   <os>
Aug 14 14:58:20 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:58:20 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:58:20 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:58:20 user nova-compute[73254]:   </os>
Aug 14 14:58:20 user nova-compute[73254]:   <features>
Aug 14 14:58:20 user nova-compute[73254]:     <acpi/>
Aug 14 14:58:20 user nova-compute[73254]:     <apic/>
Aug 14 14:58:20 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:58:20 user nova-compute[73254]:   </features>
Aug 14 14:58:20 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:58:20 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:58:20 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:58:20 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:58:20 user nova-compute[73254]:   </clock>
Aug 14 14:58:20 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:58:20 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:58:20 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:58:20 user nova-compute[73254]:   </cpu>
Aug 14 14:58:20 user nova-compute[73254]:   <devices>
Aug 14 14:58:20 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 14:58:20 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:58:20 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk"/>
Aug 14 14:58:20 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:58:20 user nova-compute[73254]:     </disk>
Aug 14 14:58:20 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:58:20 user nova-compute[73254]:       <mac address="fa:16:3e:02:af:58"/>
Aug 14 14:58:20 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:20 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:58:20 user nova-compute[73254]:       <target dev="tap5ce5ac2e-ae"/>
Aug 14 14:58:20 user nova-compute[73254]:     </interface>
Aug 14 14:58:20 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:58:20 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/console.log" append="off"/>
Aug 14 14:58:20 user nova-compute[73254]:     </serial>
Aug 14 14:58:20 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:58:20 user nova-compute[73254]:     <video>
Aug 14 14:58:20 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:20 user nova-compute[73254]:     </video>
Aug 14 14:58:20 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:58:20 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:58:20 user nova-compute[73254]:     </rng>
Aug 14 14:58:20 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:58:20 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:58:20 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:58:20 user nova-compute[73254]:     </memballoon>
Aug 14 14:58:20 user nova-compute[73254]:   </devices>
Aug 14 14:58:20 user nova-compute[73254]: </domain>
Aug 14 14:58:20 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1755851336',display_name='tempest-ServerActionsTestOtherB-server-1755851336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1755851336',id=2,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpJqshf7dgOYCNb3XdGQKDGpgxinwrIHq7RhTsMWSm+s6EZD5PqStn0mS7XZys0yosnUZjjjacxB+uA7VCgltNQhd/8n8Kmf9j/njpDibTqPOQpZxcFfHs+Tu7LtgV0vQ==',key_name='tempest-keypair-50791975',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7efec9b494b419d88e619898e61108c',ramdisk_id='',reservation_id='r-raqid4hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-872428687',owner_user_name='tempest-ServerActionsTestOtherB-872428687-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02901b088217434eb2a8a4f914ac3e18',uuid=0110dafc-b336-45bd-aade-0eb9ba632a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converting VIF {"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG os_vif [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ce5ac2e-ae, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ce5ac2e-ae, col_values=(('external_ids', {'iface-id': '5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:af:58', 'vm-uuid': '0110dafc-b336-45bd-aade-0eb9ba632a05'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:20 user nova-compute[73254]: INFO os_vif [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae')
Aug 14 14:58:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:58:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] No VIF found with MAC fa:16:3e:02:af:58, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:58:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025103.26779, 01e4cd7e-3fd9-47fe-870e-31fcd457e263 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:23 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] VM Resumed (Lifecycle Event)
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:58:23 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Instance spawned successfully.
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:23 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025103.2734044, 01e4cd7e-3fd9-47fe-870e-31fcd457e263 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:23 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] VM Started (Lifecycle Event)
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.network.neutron [req-636e61bd-b1d2-4e69-b24a-8960bb8cc64a req-d80a2cc1-c7f2-47ff-b96b-7d7c5ef60206 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updated VIF entry in instance network info cache for port 5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.network.neutron [req-636e61bd-b1d2-4e69-b24a-8960bb8cc64a req-d80a2cc1-c7f2-47ff-b96b-7d7c5ef60206 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance_info_cache with network_info: [{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:23 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:23 user nova-compute[73254]: INFO nova.compute.manager [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Took 10.89 seconds to spawn the instance on the hypervisor.
Aug 14 14:58:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-636e61bd-b1d2-4e69-b24a-8960bb8cc64a req-d80a2cc1-c7f2-47ff-b96b-7d7c5ef60206 service nova] Releasing lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:23 user nova-compute[73254]: INFO nova.compute.manager [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Took 11.94 seconds to build instance.
Aug 14 14:58:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5766357a-d9ba-45d2-9c1a-f44af9b96eb5 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.114s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025105.4309766, 0110dafc-b336-45bd-aade-0eb9ba632a05 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:25 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] VM Resumed (Lifecycle Event)
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:58:25 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance spawned successfully.
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:25 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025105.4423122, 0110dafc-b336-45bd-aade-0eb9ba632a05 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:25 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] VM Started (Lifecycle Event)
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:25 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:25 user nova-compute[73254]: INFO nova.compute.manager [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Took 14.17 seconds to spawn the instance on the hypervisor.
Aug 14 14:58:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:25 user nova-compute[73254]: INFO nova.compute.manager [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Took 14.98 seconds to build instance.
Aug 14 14:58:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1c18804-0b70-4949-83d8-3ca870f88425 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.266s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:58:32 user nova-compute[73254]: INFO nova.compute.claims [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Claim successful on node user
Aug 14 14:58:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Acquiring lock "94250a67-88b2-48ac-88ad-8b298cf66692" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "94250a67-88b2-48ac-88ad-8b298cf66692" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:58:32 user nova-compute[73254]: INFO nova.compute.claims [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Claim successful on node user
Aug 14 14:58:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:58:32 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:58:32 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 14 14:58:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG nova.policy [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba3d92631f1c4b6cbd737817c7b0778b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a37e80fa39b474fbfd3c91291de9b53', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:58:33 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Creating image(s)
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "/opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "/opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "/opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "972ef8209b164c7cdb417f33a714f8be743d77e2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "972ef8209b164c7cdb417f33a714f8be743d77e2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2.part --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2.part --force-share --output=json" returned: 0 in 0.216s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG nova.virt.images [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] 017a02e5-5386-4c50-98a2-f7c1a3f7c623 was qcow2, converting to raw {{(pid=73254) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2.part /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2.converted {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:33 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.322s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.385s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:58:34 user nova-compute[73254]: INFO nova.compute.claims [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Claim successful on node user
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2.part /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2.converted" returned: 0 in 0.297s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2.converted --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG nova.network.neutron [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:58:34 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:58:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG nova.policy [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb0652fd2e20423981a7173e0f7e9ecb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fb17959991948c5a5ec5ad23198e31f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2.converted --force-share --output=json" returned: 0 in 0.310s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "972ef8209b164c7cdb417f33a714f8be743d77e2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.389s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:58:34 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Creating image(s)
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Acquiring lock "/opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "/opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "/opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2 --force-share --output=json" returned: 0 in 0.283s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "972ef8209b164c7cdb417f33a714f8be743d77e2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "972ef8209b164c7cdb417f33a714f8be743d77e2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Successfully created port: 86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.239s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2 --force-share --output=json" returned: 0 in 0.244s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2,backing_fmt=raw /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2,backing_fmt=raw /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk 1073741824" returned: 0 in 0.058s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "972ef8209b164c7cdb417f33a714f8be743d77e2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.256s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-270b666c-f1ff-4933-a521-26d0969c74b1 req-179b0d9f-db23-4667-bb25-5ad20a471570 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-270b666c-f1ff-4933-a521-26d0969c74b1 req-179b0d9f-db23-4667-bb25-5ad20a471570 service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-270b666c-f1ff-4933-a521-26d0969c74b1 req-179b0d9f-db23-4667-bb25-5ad20a471570 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-270b666c-f1ff-4933-a521-26d0969c74b1 req-179b0d9f-db23-4667-bb25-5ad20a471570 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-270b666c-f1ff-4933-a521-26d0969c74b1 req-179b0d9f-db23-4667-bb25-5ad20a471570 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:35 user nova-compute[73254]: WARNING nova.compute.manager [req-270b666c-f1ff-4933-a521-26d0969c74b1 req-179b0d9f-db23-4667-bb25-5ad20a471570 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state active and task_state None.
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk 1073741824" returned: 0 in 0.098s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.361s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2 --force-share --output=json" returned: 0 in 0.249s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.429s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.245s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Cannot resize image /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lazy-loading 'migration_context' on Instance uuid c07824af-f4a5-4018-a1e5-40cb58643bc8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Ensure instance console log exists: /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.network.neutron [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:58:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Cannot resize image /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lazy-loading 'migration_context' on Instance uuid 94250a67-88b2-48ac-88ad-8b298cf66692 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Ensure instance console log exists: /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:58:36 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Creating image(s)
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "/opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "/opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "/opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG nova.network.neutron [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Successfully created port: 83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG nova.policy [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0faec8d574c343b5a9105c5224881b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4479f583d4794b615fe3e28d8ee7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.229s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.323s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk 1073741824" returned: 0 in 0.307s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.637s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.252s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-f45c3dca-040e-4ca1-b59f-81c1949e4933 req-b61e2360-40bd-47af-bf52-db62174b9b0f service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f45c3dca-040e-4ca1-b59f-81c1949e4933 req-b61e2360-40bd-47af-bf52-db62174b9b0f service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f45c3dca-040e-4ca1-b59f-81c1949e4933 req-b61e2360-40bd-47af-bf52-db62174b9b0f service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f45c3dca-040e-4ca1-b59f-81c1949e4933 req-b61e2360-40bd-47af-bf52-db62174b9b0f service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-f45c3dca-040e-4ca1-b59f-81c1949e4933 req-b61e2360-40bd-47af-bf52-db62174b9b0f service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:37 user nova-compute[73254]: WARNING nova.compute.manager [req-f45c3dca-040e-4ca1-b59f-81c1949e4933 req-b61e2360-40bd-47af-bf52-db62174b9b0f service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state active and task_state None.
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Successfully updated port: 86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Cannot resize image /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.objects.instance [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lazy-loading 'migration_context' on Instance uuid da915cb7-8ab5-4c65-928f-70e94811dd4e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "refresh_cache-c07824af-f4a5-4018-a1e5-40cb58643bc8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquired lock "refresh_cache-c07824af-f4a5-4018-a1e5-40cb58643bc8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Ensure instance console log exists: /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-7411da2b-f2a1-4f3d-ac89-155ff9e35c3f req-75053b3b-d837-4794-adf4-0818126bfeae service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received event network-changed-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-7411da2b-f2a1-4f3d-ac89-155ff9e35c3f req-75053b3b-d837-4794-adf4-0818126bfeae service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Refreshing instance network info cache due to event network-changed-86ba53fe-cce2-4789-bba6-f5c6dc63300c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7411da2b-f2a1-4f3d-ac89-155ff9e35c3f req-75053b3b-d837-4794-adf4-0818126bfeae service nova] Acquiring lock "refresh_cache-c07824af-f4a5-4018-a1e5-40cb58643bc8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Successfully updated port: 83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Acquiring lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Acquired lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:58:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Updating instance_info_cache with network_info: [{"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Releasing lock "refresh_cache-c07824af-f4a5-4018-a1e5-40cb58643bc8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Instance network_info: |[{"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7411da2b-f2a1-4f3d-ac89-155ff9e35c3f req-75053b3b-d837-4794-adf4-0818126bfeae service nova] Acquired lock "refresh_cache-c07824af-f4a5-4018-a1e5-40cb58643bc8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.neutron [req-7411da2b-f2a1-4f3d-ac89-155ff9e35c3f req-75053b3b-d837-4794-adf4-0818126bfeae service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Refreshing network info cache for port 86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Start _get_guest_xml network_info=[{"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:58:21Z,direct_url=<?>,disk_format='qcow2',id=017a02e5-5386-4c50-98a2-f7c1a3f7c623,min_disk=0,min_ram=0,name='',owner='287af7c657314e3bb032c7af3fc49e45',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:58:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'scsi', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/sda', 'encryption_format': None, 'image_id': '017a02e5-5386-4c50-98a2-f7c1a3f7c623'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Updating instance_info_cache with network_info: [{"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Successfully created port: fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Releasing lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Instance network_info: |[{"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Start _get_guest_xml network_info=[{"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:58:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:58:21Z,direct_url=<?>,disk_format='qcow2',id=017a02e5-5386-4c50-98a2-f7c1a3f7c623,min_disk=0,min_ram=0,name='',owner='287af7c657314e3bb032c7af3fc49e45',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:58:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:58:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1417561268',display_name='tempest-AttachSCSIVolumeTestJSON-server-1417561268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1417561268',id=4,image_ref='017a02e5-5386-4c50-98a2-f7c1a3f7c623',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBNobus2LDKtN1WUUenLVHGIlQkI+fLzYf1FHb25Wl2UcBEvlhP4QiNinRvI6ycf/6p5+KhIeV/Yati8BAwStYALEPZw1zFGD4+T1A/HpsZSdkYf/Lzuu7IP23D0196LQ==',key_name='tempest-keypair-1027271895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a37e80fa39b474fbfd3c91291de9b53',ramdisk_id='',reservation_id='r-qcydti4z',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='017a02e5-5386-4c50-98a2-f7c1a3f7c623',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1168386333',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1168386333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba3d92631f1c4b6cbd737817c7b0778b',uuid=c07824af-f4a5-4018-a1e5-40cb58643bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Converting VIF {"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:2b,bridge_name='br-int',has_traffic_filtering=True,id=86ba53fe-cce2-4789-bba6-f5c6dc63300c,network=Network(187726ca-cf7c-40d7-ad82-54532816b6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ba53fe-cc') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lazy-loading 'pci_devices' on Instance uuid c07824af-f4a5-4018-a1e5-40cb58643bc8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-658009832',display_name='tempest-VolumesAssistedSnapshotsTest-server-658009832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-658009832',id=5,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPNyoN74IhOsW38/V4ypgLjaxOix1DdVCpNNg7BB7sX38BLmQKYBxA7jBMIQVXIufPbU/rL+qnXzk+GgTQ4z5KOXgCv3gMBYvOqWE+BKvSRxMRaC/Po2roTdLnDqDKSA==',key_name='tempest-keypair-1797260486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb17959991948c5a5ec5ad23198e31f',ramdisk_id='',reservation_id='r-9yxje53v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-374551747',owner_user_name='tempest-VolumesAssistedSnapshotsTest-374551747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb0652fd2e20423981a7173e0f7e9ecb',uuid=94250a67-88b2-48ac-88ad-8b298cf66692,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Converting VIF {"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:bb:ac,bridge_name='br-int',has_traffic_filtering=True,id=83dbfd08-9b03-4c15-a4ad-52c48518c446,network=Network(8e542012-1424-486e-9338-188985d6bf35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dbfd08-9b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lazy-loading 'pci_devices' on Instance uuid 94250a67-88b2-48ac-88ad-8b298cf66692 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:58:38 user nova-compute[73254]:   <uuid>c07824af-f4a5-4018-a1e5-40cb58643bc8</uuid>
Aug 14 14:58:38 user nova-compute[73254]:   <name>instance-00000004</name>
Aug 14 14:58:38 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:58:38 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:58:38 user nova-compute[73254]:   <metadata>
Aug 14 14:58:38 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:58:38 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1417561268</nova:name>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:58:38</nova:creationTime>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:58:38 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:58:38 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:owner>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:user uuid="ba3d92631f1c4b6cbd737817c7b0778b">tempest-AttachSCSIVolumeTestJSON-1168386333-project-member</nova:user>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:project uuid="0a37e80fa39b474fbfd3c91291de9b53">tempest-AttachSCSIVolumeTestJSON-1168386333</nova:project>
Aug 14 14:58:38 user nova-compute[73254]:       </nova:owner>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:root type="image" uuid="017a02e5-5386-4c50-98a2-f7c1a3f7c623"/>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:ports>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:port uuid="86ba53fe-cce2-4789-bba6-f5c6dc63300c">
Aug 14 14:58:38 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 14:58:38 user nova-compute[73254]:         </nova:port>
Aug 14 14:58:38 user nova-compute[73254]:       </nova:ports>
Aug 14 14:58:38 user nova-compute[73254]:     </nova:instance>
Aug 14 14:58:38 user nova-compute[73254]:   </metadata>
Aug 14 14:58:38 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:58:38 user nova-compute[73254]:     <system>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="serial">c07824af-f4a5-4018-a1e5-40cb58643bc8</entry>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="uuid">c07824af-f4a5-4018-a1e5-40cb58643bc8</entry>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:58:38 user nova-compute[73254]:     </system>
Aug 14 14:58:38 user nova-compute[73254]:   </sysinfo>
Aug 14 14:58:38 user nova-compute[73254]:   <os>
Aug 14 14:58:38 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:58:38 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:58:38 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:58:38 user nova-compute[73254]:   </os>
Aug 14 14:58:38 user nova-compute[73254]:   <features>
Aug 14 14:58:38 user nova-compute[73254]:     <acpi/>
Aug 14 14:58:38 user nova-compute[73254]:     <apic/>
Aug 14 14:58:38 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:58:38 user nova-compute[73254]:   </features>
Aug 14 14:58:38 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:58:38 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:58:38 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:58:38 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:58:38 user nova-compute[73254]:   </clock>
Aug 14 14:58:38 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:58:38 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:58:38 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:58:38 user nova-compute[73254]:   </cpu>
Aug 14 14:58:38 user nova-compute[73254]:   <devices>
Aug 14 14:58:38 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 14:58:38 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:58:38 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk"/>
Aug 14 14:58:38 user nova-compute[73254]:       <target dev="sda" bus="scsi"/>
Aug 14 14:58:38 user nova-compute[73254]:       <address type="drive" controller="0" unit="0"/>
Aug 14 14:58:38 user nova-compute[73254]:     </disk>
Aug 14 14:58:38 user nova-compute[73254]:     <disk type="file" device="cdrom">
Aug 14 14:58:38 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 14:58:38 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk.config"/>
Aug 14 14:58:38 user nova-compute[73254]:       <target dev="sdb" bus="scsi"/>
Aug 14 14:58:38 user nova-compute[73254]:       <address type="drive" controller="0" unit="1"/>
Aug 14 14:58:38 user nova-compute[73254]:     </disk>
Aug 14 14:58:38 user nova-compute[73254]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 14 14:58:38 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:58:38 user nova-compute[73254]:       <mac address="fa:16:3e:a1:76:2b"/>
Aug 14 14:58:38 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:38 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:58:38 user nova-compute[73254]:       <target dev="tap86ba53fe-cc"/>
Aug 14 14:58:38 user nova-compute[73254]:     </interface>
Aug 14 14:58:38 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:58:38 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/console.log" append="off"/>
Aug 14 14:58:38 user nova-compute[73254]:     </serial>
Aug 14 14:58:38 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:58:38 user nova-compute[73254]:     <video>
Aug 14 14:58:38 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:38 user nova-compute[73254]:     </video>
Aug 14 14:58:38 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:58:38 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:58:38 user nova-compute[73254]:     </rng>
Aug 14 14:58:38 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:58:38 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:58:38 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:58:38 user nova-compute[73254]:     </memballoon>
Aug 14 14:58:38 user nova-compute[73254]:   </devices>
Aug 14 14:58:38 user nova-compute[73254]: </domain>
Aug 14 14:58:38 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:58:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1417561268',display_name='tempest-AttachSCSIVolumeTestJSON-server-1417561268',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1417561268',id=4,image_ref='017a02e5-5386-4c50-98a2-f7c1a3f7c623',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBNobus2LDKtN1WUUenLVHGIlQkI+fLzYf1FHb25Wl2UcBEvlhP4QiNinRvI6ycf/6p5+KhIeV/Yati8BAwStYALEPZw1zFGD4+T1A/HpsZSdkYf/Lzuu7IP23D0196LQ==',key_name='tempest-keypair-1027271895',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0a37e80fa39b474fbfd3c91291de9b53',ramdisk_id='',reservation_id='r-qcydti4z',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='017a02e5-5386-4c50-98a2-f7c1a3f7c623',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1168386333',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1168386333-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba3d92631f1c4b6cbd737817c7b0778b',uuid=c07824af-f4a5-4018-a1e5-40cb58643bc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Converting VIF {"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:2b,bridge_name='br-int',has_traffic_filtering=True,id=86ba53fe-cce2-4789-bba6-f5c6dc63300c,network=Network(187726ca-cf7c-40d7-ad82-54532816b6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ba53fe-cc') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG os_vif [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:2b,bridge_name='br-int',has_traffic_filtering=True,id=86ba53fe-cce2-4789-bba6-f5c6dc63300c,network=Network(187726ca-cf7c-40d7-ad82-54532816b6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ba53fe-cc') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:58:38 user nova-compute[73254]:   <uuid>94250a67-88b2-48ac-88ad-8b298cf66692</uuid>
Aug 14 14:58:38 user nova-compute[73254]:   <name>instance-00000005</name>
Aug 14 14:58:38 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:58:38 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:58:38 user nova-compute[73254]:   <metadata>
Aug 14 14:58:38 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:58:38 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-658009832</nova:name>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:58:38</nova:creationTime>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:58:38 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:58:38 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:owner>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:user uuid="fb0652fd2e20423981a7173e0f7e9ecb">tempest-VolumesAssistedSnapshotsTest-374551747-project-member</nova:user>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:project uuid="5fb17959991948c5a5ec5ad23198e31f">tempest-VolumesAssistedSnapshotsTest-374551747</nova:project>
Aug 14 14:58:38 user nova-compute[73254]:       </nova:owner>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 14:58:38 user nova-compute[73254]:       <nova:ports>
Aug 14 14:58:38 user nova-compute[73254]:         <nova:port uuid="83dbfd08-9b03-4c15-a4ad-52c48518c446">
Aug 14 14:58:38 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 14:58:38 user nova-compute[73254]:         </nova:port>
Aug 14 14:58:38 user nova-compute[73254]:       </nova:ports>
Aug 14 14:58:38 user nova-compute[73254]:     </nova:instance>
Aug 14 14:58:38 user nova-compute[73254]:   </metadata>
Aug 14 14:58:38 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:58:38 user nova-compute[73254]:     <system>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="serial">94250a67-88b2-48ac-88ad-8b298cf66692</entry>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="uuid">94250a67-88b2-48ac-88ad-8b298cf66692</entry>
Aug 14 14:58:38 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:58:38 user nova-compute[73254]:     </system>
Aug 14 14:58:38 user nova-compute[73254]:   </sysinfo>
Aug 14 14:58:38 user nova-compute[73254]:   <os>
Aug 14 14:58:38 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:58:38 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:58:38 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:58:38 user nova-compute[73254]:   </os>
Aug 14 14:58:38 user nova-compute[73254]:   <features>
Aug 14 14:58:38 user nova-compute[73254]:     <acpi/>
Aug 14 14:58:38 user nova-compute[73254]:     <apic/>
Aug 14 14:58:38 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:58:38 user nova-compute[73254]:   </features>
Aug 14 14:58:38 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:58:38 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:58:38 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:58:38 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:58:38 user nova-compute[73254]:   </clock>
Aug 14 14:58:38 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:58:38 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:58:38 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:58:38 user nova-compute[73254]:   </cpu>
Aug 14 14:58:38 user nova-compute[73254]:   <devices>
Aug 14 14:58:38 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 14:58:38 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:58:38 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk"/>
Aug 14 14:58:38 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:58:38 user nova-compute[73254]:     </disk>
Aug 14 14:58:38 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:58:38 user nova-compute[73254]:       <mac address="fa:16:3e:4d:bb:ac"/>
Aug 14 14:58:38 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:38 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:58:38 user nova-compute[73254]:       <target dev="tap83dbfd08-9b"/>
Aug 14 14:58:38 user nova-compute[73254]:     </interface>
Aug 14 14:58:38 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:58:38 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/console.log" append="off"/>
Aug 14 14:58:38 user nova-compute[73254]:     </serial>
Aug 14 14:58:38 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:58:38 user nova-compute[73254]:     <video>
Aug 14 14:58:38 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:38 user nova-compute[73254]:     </video>
Aug 14 14:58:38 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:58:38 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:58:38 user nova-compute[73254]:     </rng>
Aug 14 14:58:38 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:58:38 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:58:38 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:58:38 user nova-compute[73254]:     </memballoon>
Aug 14 14:58:38 user nova-compute[73254]:   </devices>
Aug 14 14:58:38 user nova-compute[73254]: </domain>
Aug 14 14:58:38 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-658009832',display_name='tempest-VolumesAssistedSnapshotsTest-server-658009832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-658009832',id=5,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPNyoN74IhOsW38/V4ypgLjaxOix1DdVCpNNg7BB7sX38BLmQKYBxA7jBMIQVXIufPbU/rL+qnXzk+GgTQ4z5KOXgCv3gMBYvOqWE+BKvSRxMRaC/Po2roTdLnDqDKSA==',key_name='tempest-keypair-1797260486',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fb17959991948c5a5ec5ad23198e31f',ramdisk_id='',reservation_id='r-9yxje53v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-374551747',owner_user_name='tempest-VolumesAssistedSnapshotsTest-374551747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb0652fd2e20423981a7173e0f7e9ecb',uuid=94250a67-88b2-48ac-88ad-8b298cf66692,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Converting VIF {"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:bb:ac,bridge_name='br-int',has_traffic_filtering=True,id=83dbfd08-9b03-4c15-a4ad-52c48518c446,network=Network(8e542012-1424-486e-9338-188985d6bf35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dbfd08-9b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG os_vif [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:bb:ac,bridge_name='br-int',has_traffic_filtering=True,id=83dbfd08-9b03-4c15-a4ad-52c48518c446,network=Network(8e542012-1424-486e-9338-188985d6bf35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dbfd08-9b') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap86ba53fe-cc, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap86ba53fe-cc, col_values=(('external_ids', {'iface-id': '86ba53fe-cce2-4789-bba6-f5c6dc63300c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:76:2b', 'vm-uuid': 'c07824af-f4a5-4018-a1e5-40cb58643bc8'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83dbfd08-9b, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83dbfd08-9b, col_values=(('external_ids', {'iface-id': '83dbfd08-9b03-4c15-a4ad-52c48518c446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:bb:ac', 'vm-uuid': '94250a67-88b2-48ac-88ad-8b298cf66692'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:38 user nova-compute[73254]: INFO os_vif [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:76:2b,bridge_name='br-int',has_traffic_filtering=True,id=86ba53fe-cce2-4789-bba6-f5c6dc63300c,network=Network(187726ca-cf7c-40d7-ad82-54532816b6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ba53fe-cc')
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:38 user nova-compute[73254]: INFO os_vif [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:bb:ac,bridge_name='br-int',has_traffic_filtering=True,id=83dbfd08-9b03-4c15-a4ad-52c48518c446,network=Network(8e542012-1424-486e-9338-188985d6bf35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dbfd08-9b')
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] No BDM found with device name sda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] No VIF found with MAC fa:16:3e:a1:76:2b, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:58:38 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Using config drive
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:58:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] No VIF found with MAC fa:16:3e:4d:bb:ac, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:58:39 user nova-compute[73254]: DEBUG nova.network.neutron [req-7411da2b-f2a1-4f3d-ac89-155ff9e35c3f req-75053b3b-d837-4794-adf4-0818126bfeae service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Updated VIF entry in instance network info cache for port 86ba53fe-cce2-4789-bba6-f5c6dc63300c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:58:39 user nova-compute[73254]: DEBUG nova.network.neutron [req-7411da2b-f2a1-4f3d-ac89-155ff9e35c3f req-75053b3b-d837-4794-adf4-0818126bfeae service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Updating instance_info_cache with network_info: [{"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7411da2b-f2a1-4f3d-ac89-155ff9e35c3f req-75053b3b-d837-4794-adf4-0818126bfeae service nova] Releasing lock "refresh_cache-c07824af-f4a5-4018-a1e5-40cb58643bc8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-12b01525-eb63-4e61-ab0a-9c8299ff7fec req-7c178caf-2237-4ca7-ac47-b60d2a5f2456 service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received event network-changed-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-12b01525-eb63-4e61-ab0a-9c8299ff7fec req-7c178caf-2237-4ca7-ac47-b60d2a5f2456 service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Refreshing instance network info cache due to event network-changed-83dbfd08-9b03-4c15-a4ad-52c48518c446. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:58:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-12b01525-eb63-4e61-ab0a-9c8299ff7fec req-7c178caf-2237-4ca7-ac47-b60d2a5f2456 service nova] Acquiring lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-12b01525-eb63-4e61-ab0a-9c8299ff7fec req-7c178caf-2237-4ca7-ac47-b60d2a5f2456 service nova] Acquired lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:39 user nova-compute[73254]: DEBUG nova.network.neutron [req-12b01525-eb63-4e61-ab0a-9c8299ff7fec req-7c178caf-2237-4ca7-ac47-b60d2a5f2456 service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Refreshing network info cache for port 83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG nova.network.neutron [req-12b01525-eb63-4e61-ab0a-9c8299ff7fec req-7c178caf-2237-4ca7-ac47-b60d2a5f2456 service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Updated VIF entry in instance network info cache for port 83dbfd08-9b03-4c15-a4ad-52c48518c446. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG nova.network.neutron [req-12b01525-eb63-4e61-ab0a-9c8299ff7fec req-7c178caf-2237-4ca7-ac47-b60d2a5f2456 service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Updating instance_info_cache with network_info: [{"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-12b01525-eb63-4e61-ab0a-9c8299ff7fec req-7c178caf-2237-4ca7-ac47-b60d2a5f2456 service nova] Releasing lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-80bcc1f1-5707-4e53-87cd-25a99ea95766 req-67dec46f-502e-4699-aee4-603e0c47861e service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Received event network-vif-plugged-c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-80bcc1f1-5707-4e53-87cd-25a99ea95766 req-67dec46f-502e-4699-aee4-603e0c47861e service nova] Acquiring lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-80bcc1f1-5707-4e53-87cd-25a99ea95766 req-67dec46f-502e-4699-aee4-603e0c47861e service nova] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-80bcc1f1-5707-4e53-87cd-25a99ea95766 req-67dec46f-502e-4699-aee4-603e0c47861e service nova] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-80bcc1f1-5707-4e53-87cd-25a99ea95766 req-67dec46f-502e-4699-aee4-603e0c47861e service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] No waiting events found dispatching network-vif-plugged-c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:40 user nova-compute[73254]: WARNING nova.compute.manager [req-80bcc1f1-5707-4e53-87cd-25a99ea95766 req-67dec46f-502e-4699-aee4-603e0c47861e service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Received unexpected event network-vif-plugged-c3f17283-3785-4d52-81a1-f8f65da2404d for instance with vm_state active and task_state None.
Aug 14 14:58:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:40 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Creating config drive at /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk.config
Aug 14 14:58:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbs4g2pe9 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:40 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:58:40 user nova-compute[73254]: INFO nova.compute.claims [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Claim successful on node user
Aug 14 14:58:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbs4g2pe9" returned: 0 in 0.101s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG nova.network.neutron [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Successfully updated port: fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquired lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG nova.network.neutron [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.933s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-94fb5b41-3b57-4f0f-8762-07a4b2500509 req-e2485281-5252-4c35-b31d-51c948f13460 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received event network-changed-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-94fb5b41-3b57-4f0f-8762-07a4b2500509 req-e2485281-5252-4c35-b31d-51c948f13460 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Refreshing instance network info cache due to event network-changed-fd587446-7efc-479b-ba55-a4f56918b88d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-94fb5b41-3b57-4f0f-8762-07a4b2500509 req-e2485281-5252-4c35-b31d-51c948f13460 service nova] Acquiring lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:58:41 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.network.neutron [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:58:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:58:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Creating image(s)
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "/opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "/opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.policy [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56e9ec47f996447e9f8636a716ae6fd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d45f7768d534479811ccd77e0d68e3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.214s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk 1073741824" returned: 0 in 0.096s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.network.neutron [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Updating instance_info_cache with network_info: [{"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-e1dc0a72-6e8f-446e-ae04-89ba8113fd9e req-d8df4548-52a2-4123-9fb9-6abe66aba3ee service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Received event network-vif-plugged-c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1dc0a72-6e8f-446e-ae04-89ba8113fd9e req-d8df4548-52a2-4123-9fb9-6abe66aba3ee service nova] Acquiring lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1dc0a72-6e8f-446e-ae04-89ba8113fd9e req-d8df4548-52a2-4123-9fb9-6abe66aba3ee service nova] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1dc0a72-6e8f-446e-ae04-89ba8113fd9e req-d8df4548-52a2-4123-9fb9-6abe66aba3ee service nova] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-e1dc0a72-6e8f-446e-ae04-89ba8113fd9e req-d8df4548-52a2-4123-9fb9-6abe66aba3ee service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] No waiting events found dispatching network-vif-plugged-c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:42 user nova-compute[73254]: WARNING nova.compute.manager [req-e1dc0a72-6e8f-446e-ae04-89ba8113fd9e req-d8df4548-52a2-4123-9fb9-6abe66aba3ee service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Received unexpected event network-vif-plugged-c3f17283-3785-4d52-81a1-f8f65da2404d for instance with vm_state active and task_state None.
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Releasing lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Instance network_info: |[{"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-94fb5b41-3b57-4f0f-8762-07a4b2500509 req-e2485281-5252-4c35-b31d-51c948f13460 service nova] Acquired lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.network.neutron [req-94fb5b41-3b57-4f0f-8762-07a4b2500509 req-e2485281-5252-4c35-b31d-51c948f13460 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Refreshing network info cache for port fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Start _get_guest_xml network_info=[{"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:58:42 user nova-compute[73254]: INFO nova.compute.claims [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Claim successful on node user
Aug 14 14:58:42 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:42 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-289777810',display_name='tempest-VolumesAdminNegativeTest-server-289777810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-289777810',id=6,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMvmCmDreH4NdwkDp0cxqi0jBy+Pq38S82XljegxGcgZMit83jWB+wD0AqIK0/FAySH4W8z1vrqf9cGfV/28jMe0rjBhF9lyP8nTfTTypMKgaYNpz6D1jC0o9YBQobPbg==',key_name='tempest-keypair-2047795832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e4479f583d4794b615fe3e28d8ee7f',ramdisk_id='',reservation_id='r-0ub9wjq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-656235791',owner_user_name='tempest-VolumesAdminNegativeTest-656235791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0faec8d574c343b5a9105c5224881b80',uuid=da915cb7-8ab5-4c65-928f-70e94811dd4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converting VIF {"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:81:06,bridge_name='br-int',has_traffic_filtering=True,id=fd587446-7efc-479b-ba55-a4f56918b88d,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd587446-7e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lazy-loading 'pci_devices' on Instance uuid da915cb7-8ab5-4c65-928f-70e94811dd4e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-f0f10e58-7862-4945-8df6-f445acc76075 req-55a5d291-beba-4acb-a8fd-83fc1a656b6f service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received event network-vif-plugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f0f10e58-7862-4945-8df6-f445acc76075 req-55a5d291-beba-4acb-a8fd-83fc1a656b6f service nova] Acquiring lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f0f10e58-7862-4945-8df6-f445acc76075 req-55a5d291-beba-4acb-a8fd-83fc1a656b6f service nova] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f0f10e58-7862-4945-8df6-f445acc76075 req-55a5d291-beba-4acb-a8fd-83fc1a656b6f service nova] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-f0f10e58-7862-4945-8df6-f445acc76075 req-55a5d291-beba-4acb-a8fd-83fc1a656b6f service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] No waiting events found dispatching network-vif-plugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:43 user nova-compute[73254]: WARNING nova.compute.manager [req-f0f10e58-7862-4945-8df6-f445acc76075 req-55a5d291-beba-4acb-a8fd-83fc1a656b6f service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received unexpected event network-vif-plugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c for instance with vm_state building and task_state spawning.
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:58:43 user nova-compute[73254]:   <uuid>da915cb7-8ab5-4c65-928f-70e94811dd4e</uuid>
Aug 14 14:58:43 user nova-compute[73254]:   <name>instance-00000006</name>
Aug 14 14:58:43 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:58:43 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:58:43 user nova-compute[73254]:   <metadata>
Aug 14 14:58:43 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:58:43 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:58:43 user nova-compute[73254]:       <nova:name>tempest-VolumesAdminNegativeTest-server-289777810</nova:name>
Aug 14 14:58:43 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:58:42</nova:creationTime>
Aug 14 14:58:43 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:58:43 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:58:43 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:58:43 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:58:43 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:58:43 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:58:43 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:58:43 user nova-compute[73254]:       <nova:owner>
Aug 14 14:58:43 user nova-compute[73254]:         <nova:user uuid="0faec8d574c343b5a9105c5224881b80">tempest-VolumesAdminNegativeTest-656235791-project-member</nova:user>
Aug 14 14:58:43 user nova-compute[73254]:         <nova:project uuid="60e4479f583d4794b615fe3e28d8ee7f">tempest-VolumesAdminNegativeTest-656235791</nova:project>
Aug 14 14:58:43 user nova-compute[73254]:       </nova:owner>
Aug 14 14:58:43 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 14:58:43 user nova-compute[73254]:       <nova:ports>
Aug 14 14:58:43 user nova-compute[73254]:         <nova:port uuid="fd587446-7efc-479b-ba55-a4f56918b88d">
Aug 14 14:58:43 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 14:58:43 user nova-compute[73254]:         </nova:port>
Aug 14 14:58:43 user nova-compute[73254]:       </nova:ports>
Aug 14 14:58:43 user nova-compute[73254]:     </nova:instance>
Aug 14 14:58:43 user nova-compute[73254]:   </metadata>
Aug 14 14:58:43 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:58:43 user nova-compute[73254]:     <system>
Aug 14 14:58:43 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:58:43 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:58:43 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:58:43 user nova-compute[73254]:       <entry name="serial">da915cb7-8ab5-4c65-928f-70e94811dd4e</entry>
Aug 14 14:58:43 user nova-compute[73254]:       <entry name="uuid">da915cb7-8ab5-4c65-928f-70e94811dd4e</entry>
Aug 14 14:58:43 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:58:43 user nova-compute[73254]:     </system>
Aug 14 14:58:43 user nova-compute[73254]:   </sysinfo>
Aug 14 14:58:43 user nova-compute[73254]:   <os>
Aug 14 14:58:43 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:58:43 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:58:43 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:58:43 user nova-compute[73254]:   </os>
Aug 14 14:58:43 user nova-compute[73254]:   <features>
Aug 14 14:58:43 user nova-compute[73254]:     <acpi/>
Aug 14 14:58:43 user nova-compute[73254]:     <apic/>
Aug 14 14:58:43 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:58:43 user nova-compute[73254]:   </features>
Aug 14 14:58:43 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:58:43 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:58:43 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:58:43 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:58:43 user nova-compute[73254]:   </clock>
Aug 14 14:58:43 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:58:43 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:58:43 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:58:43 user nova-compute[73254]:   </cpu>
Aug 14 14:58:43 user nova-compute[73254]:   <devices>
Aug 14 14:58:43 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 14:58:43 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:58:43 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk"/>
Aug 14 14:58:43 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:58:43 user nova-compute[73254]:     </disk>
Aug 14 14:58:43 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:58:43 user nova-compute[73254]:       <mac address="fa:16:3e:c2:81:06"/>
Aug 14 14:58:43 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:43 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:58:43 user nova-compute[73254]:       <target dev="tapfd587446-7e"/>
Aug 14 14:58:43 user nova-compute[73254]:     </interface>
Aug 14 14:58:43 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:58:43 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/console.log" append="off"/>
Aug 14 14:58:43 user nova-compute[73254]:     </serial>
Aug 14 14:58:43 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:58:43 user nova-compute[73254]:     <video>
Aug 14 14:58:43 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:43 user nova-compute[73254]:     </video>
Aug 14 14:58:43 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:58:43 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:58:43 user nova-compute[73254]:     </rng>
Aug 14 14:58:43 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:58:43 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:58:43 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:58:43 user nova-compute[73254]:     </memballoon>
Aug 14 14:58:43 user nova-compute[73254]:   </devices>
Aug 14 14:58:43 user nova-compute[73254]: </domain>
Aug 14 14:58:43 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-289777810',display_name='tempest-VolumesAdminNegativeTest-server-289777810',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-289777810',id=6,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMvmCmDreH4NdwkDp0cxqi0jBy+Pq38S82XljegxGcgZMit83jWB+wD0AqIK0/FAySH4W8z1vrqf9cGfV/28jMe0rjBhF9lyP8nTfTTypMKgaYNpz6D1jC0o9YBQobPbg==',key_name='tempest-keypair-2047795832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e4479f583d4794b615fe3e28d8ee7f',ramdisk_id='',reservation_id='r-0ub9wjq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-656235791',owner_user_name='tempest-VolumesAdminNegativeTest-656235791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0faec8d574c343b5a9105c5224881b80',uuid=da915cb7-8ab5-4c65-928f-70e94811dd4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converting VIF {"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:81:06,bridge_name='br-int',has_traffic_filtering=True,id=fd587446-7efc-479b-ba55-a4f56918b88d,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd587446-7e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG os_vif [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:81:06,bridge_name='br-int',has_traffic_filtering=True,id=fd587446-7efc-479b-ba55-a4f56918b88d,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd587446-7e') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.307s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd587446-7e, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd587446-7e, col_values=(('external_ids', {'iface-id': 'fd587446-7efc-479b-ba55-a4f56918b88d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:81:06', 'vm-uuid': 'da915cb7-8ab5-4c65-928f-70e94811dd4e'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:43 user nova-compute[73254]: INFO os_vif [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:81:06,bridge_name='br-int',has_traffic_filtering=True,id=fd587446-7efc-479b-ba55-a4f56918b88d,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd587446-7e')
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] No VIF found with MAC fa:16:3e:c2:81:06, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Cannot resize image /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.objects.instance [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lazy-loading 'migration_context' on Instance uuid fe35bcec-a10d-4554-8cd7-1a9d1a72f484 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Ensure instance console log exists: /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.834s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.network.neutron [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:58:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:58:43 user nova-compute[73254]: DEBUG nova.policy [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd387ffd01c7847c590051e5c685cbabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc73fa0a494e44b42a9271927ec303', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:58:44 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Creating image(s)
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "/opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "/opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "/opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Successfully created port: 76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.network.neutron [req-94fb5b41-3b57-4f0f-8762-07a4b2500509 req-e2485281-5252-4c35-b31d-51c948f13460 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Updated VIF entry in instance network info cache for port fd587446-7efc-479b-ba55-a4f56918b88d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.network.neutron [req-94fb5b41-3b57-4f0f-8762-07a4b2500509 req-e2485281-5252-4c35-b31d-51c948f13460 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Updating instance_info_cache with network_info: [{"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-94fb5b41-3b57-4f0f-8762-07a4b2500509 req-e2485281-5252-4c35-b31d-51c948f13460 service nova] Releasing lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.252s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.254s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk 1073741824" returned: 0 in 0.085s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.350s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Successfully created port: 45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.210s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025124.8940933, 94250a67-88b2-48ac-88ad-8b298cf66692 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:44 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] VM Resumed (Lifecycle Event)
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:44 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Instance spawned successfully.
Aug 14 14:58:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025124.9025974, 94250a67-88b2-48ac-88ad-8b298cf66692 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] VM Started (Lifecycle Event)
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:45 user nova-compute[73254]: INFO nova.compute.manager [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Took 10.51 seconds to spawn the instance on the hypervisor.
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.353s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Cannot resize image /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.objects.instance [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lazy-loading 'migration_context' on Instance uuid 2d7ac783-716a-4c23-9466-fa7d5eae73a8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Ensure instance console log exists: /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-ce995a49-ec9a-4213-9fa1-da04ebdd9a50 req-95c45a59-9589-4d7f-9850-a12092760f7f service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received event network-vif-plugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ce995a49-ec9a-4213-9fa1-da04ebdd9a50 req-95c45a59-9589-4d7f-9850-a12092760f7f service nova] Acquiring lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ce995a49-ec9a-4213-9fa1-da04ebdd9a50 req-95c45a59-9589-4d7f-9850-a12092760f7f service nova] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ce995a49-ec9a-4213-9fa1-da04ebdd9a50 req-95c45a59-9589-4d7f-9850-a12092760f7f service nova] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-ce995a49-ec9a-4213-9fa1-da04ebdd9a50 req-95c45a59-9589-4d7f-9850-a12092760f7f service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] No waiting events found dispatching network-vif-plugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:45 user nova-compute[73254]: WARNING nova.compute.manager [req-ce995a49-ec9a-4213-9fa1-da04ebdd9a50 req-95c45a59-9589-4d7f-9850-a12092760f7f service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received unexpected event network-vif-plugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c for instance with vm_state building and task_state spawning.
Aug 14 14:58:45 user nova-compute[73254]: INFO nova.compute.manager [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Took 12.58 seconds to build instance.
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ff97d00-10c8-4ae8-a8f5-dcd1f9745c17 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "94250a67-88b2-48ac-88ad-8b298cf66692" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.845s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Successfully updated port: 76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquired lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025125.567648, c07824af-f4a5-4018-a1e5-40cb58643bc8 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] VM Resumed (Lifecycle Event)
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-78dfd0cf-ebd7-4a17-a4f0-9e31f81980c1 req-e44b4a3f-2933-41d0-9430-58ec689cb317 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received event network-changed-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-78dfd0cf-ebd7-4a17-a4f0-9e31f81980c1 req-e44b4a3f-2933-41d0-9430-58ec689cb317 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Refreshing instance network info cache due to event network-changed-76fee70f-931e-4f07-97c3-038f881fbaf3. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-78dfd0cf-ebd7-4a17-a4f0-9e31f81980c1 req-e44b4a3f-2933-41d0-9430-58ec689cb317 service nova] Acquiring lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Instance spawned successfully.
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025125.567797, c07824af-f4a5-4018-a1e5-40cb58643bc8 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] VM Started (Lifecycle Event)
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:46 user nova-compute[73254]: INFO nova.compute.manager [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Took 12.87 seconds to spawn the instance on the hypervisor.
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:46 user nova-compute[73254]: INFO nova.compute.manager [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Took 14.19 seconds to build instance.
Aug 14 14:58:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0ce6badf-51a5-4396-bf6a-13d221ecbf85 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.372s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Updating instance_info_cache with network_info: [{"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Releasing lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Instance network_info: |[{"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-78dfd0cf-ebd7-4a17-a4f0-9e31f81980c1 req-e44b4a3f-2933-41d0-9430-58ec689cb317 service nova] Acquired lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.neutron [req-78dfd0cf-ebd7-4a17-a4f0-9e31f81980c1 req-e44b4a3f-2933-41d0-9430-58ec689cb317 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Refreshing network info cache for port 76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Start _get_guest_xml network_info=[{"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:58:46 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:46 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.neutron [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Successfully updated port: 45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1338470371',display_name='tempest-TestVolumeSwap-server-1338470371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1338470371',id=7,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPMX8Y9HsHAZs1hjzLmSOJdmsc7A9Y/32bVj6dJpxpzOyWACcjfppcUWaULN6k3+qu+/OM+fLhf+UPoUHdJ2R0ti5bFLuN00BhE1ZrQIER3BfQVH+nZu9iLnUgDC5OqYg==',key_name='tempest-keypair-325102393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d45f7768d534479811ccd77e0d68e3c',ramdisk_id='',reservation_id='r-x897bu7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-879295236',owner_user_name='tempest-TestVolumeSwap-879295236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e9ec47f996447e9f8636a716ae6fd9',uuid=fe35bcec-a10d-4554-8cd7-1a9d1a72f484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Converting VIF {"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f2:d5,bridge_name='br-int',has_traffic_filtering=True,id=76fee70f-931e-4f07-97c3-038f881fbaf3,network=Network(0959107e-cd27-4f83-b3d6-34aeae90059a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76fee70f-93') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lazy-loading 'pci_devices' on Instance uuid fe35bcec-a10d-4554-8cd7-1a9d1a72f484 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquired lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.neutron [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:58:46 user nova-compute[73254]:   <uuid>fe35bcec-a10d-4554-8cd7-1a9d1a72f484</uuid>
Aug 14 14:58:46 user nova-compute[73254]:   <name>instance-00000007</name>
Aug 14 14:58:46 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:58:46 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:58:46 user nova-compute[73254]:   <metadata>
Aug 14 14:58:46 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:58:46 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:58:46 user nova-compute[73254]:       <nova:name>tempest-TestVolumeSwap-server-1338470371</nova:name>
Aug 14 14:58:46 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:58:46</nova:creationTime>
Aug 14 14:58:46 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:58:46 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:58:46 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:58:46 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:58:46 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:58:46 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:58:46 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:58:46 user nova-compute[73254]:       <nova:owner>
Aug 14 14:58:46 user nova-compute[73254]:         <nova:user uuid="56e9ec47f996447e9f8636a716ae6fd9">tempest-TestVolumeSwap-879295236-project-member</nova:user>
Aug 14 14:58:46 user nova-compute[73254]:         <nova:project uuid="8d45f7768d534479811ccd77e0d68e3c">tempest-TestVolumeSwap-879295236</nova:project>
Aug 14 14:58:46 user nova-compute[73254]:       </nova:owner>
Aug 14 14:58:46 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 14:58:46 user nova-compute[73254]:       <nova:ports>
Aug 14 14:58:46 user nova-compute[73254]:         <nova:port uuid="76fee70f-931e-4f07-97c3-038f881fbaf3">
Aug 14 14:58:46 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 14:58:46 user nova-compute[73254]:         </nova:port>
Aug 14 14:58:46 user nova-compute[73254]:       </nova:ports>
Aug 14 14:58:46 user nova-compute[73254]:     </nova:instance>
Aug 14 14:58:46 user nova-compute[73254]:   </metadata>
Aug 14 14:58:46 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:58:46 user nova-compute[73254]:     <system>
Aug 14 14:58:46 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:58:46 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:58:46 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:58:46 user nova-compute[73254]:       <entry name="serial">fe35bcec-a10d-4554-8cd7-1a9d1a72f484</entry>
Aug 14 14:58:46 user nova-compute[73254]:       <entry name="uuid">fe35bcec-a10d-4554-8cd7-1a9d1a72f484</entry>
Aug 14 14:58:46 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:58:46 user nova-compute[73254]:     </system>
Aug 14 14:58:46 user nova-compute[73254]:   </sysinfo>
Aug 14 14:58:46 user nova-compute[73254]:   <os>
Aug 14 14:58:46 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:58:46 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:58:46 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:58:46 user nova-compute[73254]:   </os>
Aug 14 14:58:46 user nova-compute[73254]:   <features>
Aug 14 14:58:46 user nova-compute[73254]:     <acpi/>
Aug 14 14:58:46 user nova-compute[73254]:     <apic/>
Aug 14 14:58:46 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:58:46 user nova-compute[73254]:   </features>
Aug 14 14:58:46 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:58:46 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:58:46 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:58:46 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:58:46 user nova-compute[73254]:   </clock>
Aug 14 14:58:46 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:58:46 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:58:46 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:58:46 user nova-compute[73254]:   </cpu>
Aug 14 14:58:46 user nova-compute[73254]:   <devices>
Aug 14 14:58:46 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 14:58:46 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:58:46 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk"/>
Aug 14 14:58:46 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:58:46 user nova-compute[73254]:     </disk>
Aug 14 14:58:46 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:58:46 user nova-compute[73254]:       <mac address="fa:16:3e:20:f2:d5"/>
Aug 14 14:58:46 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:46 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:58:46 user nova-compute[73254]:       <target dev="tap76fee70f-93"/>
Aug 14 14:58:46 user nova-compute[73254]:     </interface>
Aug 14 14:58:46 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:58:46 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/console.log" append="off"/>
Aug 14 14:58:46 user nova-compute[73254]:     </serial>
Aug 14 14:58:46 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:58:46 user nova-compute[73254]:     <video>
Aug 14 14:58:46 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:46 user nova-compute[73254]:     </video>
Aug 14 14:58:46 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:58:46 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:58:46 user nova-compute[73254]:     </rng>
Aug 14 14:58:46 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:58:46 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:58:46 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:58:46 user nova-compute[73254]:     </memballoon>
Aug 14 14:58:46 user nova-compute[73254]:   </devices>
Aug 14 14:58:46 user nova-compute[73254]: </domain>
Aug 14 14:58:46 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1338470371',display_name='tempest-TestVolumeSwap-server-1338470371',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1338470371',id=7,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPMX8Y9HsHAZs1hjzLmSOJdmsc7A9Y/32bVj6dJpxpzOyWACcjfppcUWaULN6k3+qu+/OM+fLhf+UPoUHdJ2R0ti5bFLuN00BhE1ZrQIER3BfQVH+nZu9iLnUgDC5OqYg==',key_name='tempest-keypair-325102393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8d45f7768d534479811ccd77e0d68e3c',ramdisk_id='',reservation_id='r-x897bu7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-879295236',owner_user_name='tempest-TestVolumeSwap-879295236-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e9ec47f996447e9f8636a716ae6fd9',uuid=fe35bcec-a10d-4554-8cd7-1a9d1a72f484,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Converting VIF {"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:f2:d5,bridge_name='br-int',has_traffic_filtering=True,id=76fee70f-931e-4f07-97c3-038f881fbaf3,network=Network(0959107e-cd27-4f83-b3d6-34aeae90059a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76fee70f-93') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG os_vif [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f2:d5,bridge_name='br-int',has_traffic_filtering=True,id=76fee70f-931e-4f07-97c3-038f881fbaf3,network=Network(0959107e-cd27-4f83-b3d6-34aeae90059a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76fee70f-93') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76fee70f-93, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap76fee70f-93, col_values=(('external_ids', {'iface-id': '76fee70f-931e-4f07-97c3-038f881fbaf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:f2:d5', 'vm-uuid': 'fe35bcec-a10d-4554-8cd7-1a9d1a72f484'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:46 user nova-compute[73254]: INFO os_vif [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:f2:d5,bridge_name='br-int',has_traffic_filtering=True,id=76fee70f-931e-4f07-97c3-038f881fbaf3,network=Network(0959107e-cd27-4f83-b3d6-34aeae90059a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76fee70f-93')
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.neutron [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] No VIF found with MAC fa:16:3e:20:f2:d5, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.neutron [req-78dfd0cf-ebd7-4a17-a4f0-9e31f81980c1 req-e44b4a3f-2933-41d0-9430-58ec689cb317 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Updated VIF entry in instance network info cache for port 76fee70f-931e-4f07-97c3-038f881fbaf3. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG nova.network.neutron [req-78dfd0cf-ebd7-4a17-a4f0-9e31f81980c1 req-e44b4a3f-2933-41d0-9430-58ec689cb317 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Updating instance_info_cache with network_info: [{"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-78dfd0cf-ebd7-4a17-a4f0-9e31f81980c1 req-e44b4a3f-2933-41d0-9430-58ec689cb317 service nova] Releasing lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.network.neutron [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updating instance_info_cache with network_info: [{"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Releasing lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Instance network_info: |[{"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Start _get_guest_xml network_info=[{"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:58:47 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:47 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-544943482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-544943482',id=8,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcdSxFKpASTpyKhbhzDsSWv3GXJrMID1+oMw/wX47BEW8KN1RfU7r4bg37xM5MdthGSSQ9JIDbWKb/2U2KILoiTbqPHrrAmuGNudKYu3nQs30o8jYIS9Hk8qUI1/vH5qg==',key_name='tempest-keypair-273322457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32cc73fa0a494e44b42a9271927ec303',ramdisk_id='',reservation_id='r-t6n5sxna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1515900016',owner_user_name='tempest-TaggedAttachmentsTest-1515900016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d387ffd01c7847c590051e5c685cbabf',uuid=2d7ac783-716a-4c23-9466-fa7d5eae73a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converting VIF {"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=45d7f56d-49d0-40e6-9d49-768c55a51b61,network=Network(e18bddee-e9b0-4855-8718-5ee1656987c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d7f56d-49') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.objects.instance [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lazy-loading 'pci_devices' on Instance uuid 2d7ac783-716a-4c23-9466-fa7d5eae73a8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:58:47 user nova-compute[73254]:   <uuid>2d7ac783-716a-4c23-9466-fa7d5eae73a8</uuid>
Aug 14 14:58:47 user nova-compute[73254]:   <name>instance-00000008</name>
Aug 14 14:58:47 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:58:47 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:58:47 user nova-compute[73254]:   <metadata>
Aug 14 14:58:47 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:58:47 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:58:47 user nova-compute[73254]:       <nova:name>tempest-device-tagging-server-544943482</nova:name>
Aug 14 14:58:47 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:58:47</nova:creationTime>
Aug 14 14:58:47 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:58:47 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:58:47 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:58:47 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:58:47 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:58:47 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:58:47 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:58:47 user nova-compute[73254]:       <nova:owner>
Aug 14 14:58:47 user nova-compute[73254]:         <nova:user uuid="d387ffd01c7847c590051e5c685cbabf">tempest-TaggedAttachmentsTest-1515900016-project-member</nova:user>
Aug 14 14:58:47 user nova-compute[73254]:         <nova:project uuid="32cc73fa0a494e44b42a9271927ec303">tempest-TaggedAttachmentsTest-1515900016</nova:project>
Aug 14 14:58:47 user nova-compute[73254]:       </nova:owner>
Aug 14 14:58:47 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 14:58:47 user nova-compute[73254]:       <nova:ports>
Aug 14 14:58:47 user nova-compute[73254]:         <nova:port uuid="45d7f56d-49d0-40e6-9d49-768c55a51b61">
Aug 14 14:58:47 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 14:58:47 user nova-compute[73254]:         </nova:port>
Aug 14 14:58:47 user nova-compute[73254]:       </nova:ports>
Aug 14 14:58:47 user nova-compute[73254]:     </nova:instance>
Aug 14 14:58:47 user nova-compute[73254]:   </metadata>
Aug 14 14:58:47 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:58:47 user nova-compute[73254]:     <system>
Aug 14 14:58:47 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:58:47 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:58:47 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:58:47 user nova-compute[73254]:       <entry name="serial">2d7ac783-716a-4c23-9466-fa7d5eae73a8</entry>
Aug 14 14:58:47 user nova-compute[73254]:       <entry name="uuid">2d7ac783-716a-4c23-9466-fa7d5eae73a8</entry>
Aug 14 14:58:47 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:58:47 user nova-compute[73254]:     </system>
Aug 14 14:58:47 user nova-compute[73254]:   </sysinfo>
Aug 14 14:58:47 user nova-compute[73254]:   <os>
Aug 14 14:58:47 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:58:47 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:58:47 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:58:47 user nova-compute[73254]:   </os>
Aug 14 14:58:47 user nova-compute[73254]:   <features>
Aug 14 14:58:47 user nova-compute[73254]:     <acpi/>
Aug 14 14:58:47 user nova-compute[73254]:     <apic/>
Aug 14 14:58:47 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:58:47 user nova-compute[73254]:   </features>
Aug 14 14:58:47 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:58:47 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:58:47 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:58:47 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:58:47 user nova-compute[73254]:   </clock>
Aug 14 14:58:47 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:58:47 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:58:47 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:58:47 user nova-compute[73254]:   </cpu>
Aug 14 14:58:47 user nova-compute[73254]:   <devices>
Aug 14 14:58:47 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 14:58:47 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:58:47 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk"/>
Aug 14 14:58:47 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:58:47 user nova-compute[73254]:     </disk>
Aug 14 14:58:47 user nova-compute[73254]:     <disk type="file" device="cdrom">
Aug 14 14:58:47 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 14:58:47 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk.config"/>
Aug 14 14:58:47 user nova-compute[73254]:       <target dev="hda" bus="ide"/>
Aug 14 14:58:47 user nova-compute[73254]:     </disk>
Aug 14 14:58:47 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:58:47 user nova-compute[73254]:       <mac address="fa:16:3e:01:2a:28"/>
Aug 14 14:58:47 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:47 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:58:47 user nova-compute[73254]:       <target dev="tap45d7f56d-49"/>
Aug 14 14:58:47 user nova-compute[73254]:     </interface>
Aug 14 14:58:47 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:58:47 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/console.log" append="off"/>
Aug 14 14:58:47 user nova-compute[73254]:     </serial>
Aug 14 14:58:47 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:58:47 user nova-compute[73254]:     <video>
Aug 14 14:58:47 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:58:47 user nova-compute[73254]:     </video>
Aug 14 14:58:47 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:58:47 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:58:47 user nova-compute[73254]:     </rng>
Aug 14 14:58:47 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:58:47 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:58:47 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:58:47 user nova-compute[73254]:     </memballoon>
Aug 14 14:58:47 user nova-compute[73254]:   </devices>
Aug 14 14:58:47 user nova-compute[73254]: </domain>
Aug 14 14:58:47 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-544943482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-544943482',id=8,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcdSxFKpASTpyKhbhzDsSWv3GXJrMID1+oMw/wX47BEW8KN1RfU7r4bg37xM5MdthGSSQ9JIDbWKb/2U2KILoiTbqPHrrAmuGNudKYu3nQs30o8jYIS9Hk8qUI1/vH5qg==',key_name='tempest-keypair-273322457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='32cc73fa0a494e44b42a9271927ec303',ramdisk_id='',reservation_id='r-t6n5sxna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1515900016',owner_user_name='tempest-TaggedAttachmentsTest-1515900016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d387ffd01c7847c590051e5c685cbabf',uuid=2d7ac783-716a-4c23-9466-fa7d5eae73a8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converting VIF {"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=45d7f56d-49d0-40e6-9d49-768c55a51b61,network=Network(e18bddee-e9b0-4855-8718-5ee1656987c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d7f56d-49') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG os_vif [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=45d7f56d-49d0-40e6-9d49-768c55a51b61,network=Network(e18bddee-e9b0-4855-8718-5ee1656987c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d7f56d-49') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45d7f56d-49, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap45d7f56d-49, col_values=(('external_ids', {'iface-id': '45d7f56d-49d0-40e6-9d49-768c55a51b61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:2a:28', 'vm-uuid': '2d7ac783-716a-4c23-9466-fa7d5eae73a8'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:47 user nova-compute[73254]: INFO os_vif [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=45d7f56d-49d0-40e6-9d49-768c55a51b61,network=Network(e18bddee-e9b0-4855-8718-5ee1656987c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d7f56d-49')
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] No BDM found with device name hda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] No VIF found with MAC fa:16:3e:01:2a:28, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:58:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Using config drive
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received event network-vif-plugged-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] No waiting events found dispatching network-vif-plugged-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:47 user nova-compute[73254]: WARNING nova.compute.manager [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received unexpected event network-vif-plugged-fd587446-7efc-479b-ba55-a4f56918b88d for instance with vm_state building and task_state spawning.
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received event network-vif-plugged-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] No waiting events found dispatching network-vif-plugged-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:47 user nova-compute[73254]: WARNING nova.compute.manager [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received unexpected event network-vif-plugged-fd587446-7efc-479b-ba55-a4f56918b88d for instance with vm_state building and task_state spawning.
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-changed-45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Refreshing instance network info cache due to event network-changed-45d7f56d-49d0-40e6-9d49-768c55a51b61. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] Acquiring lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] Acquired lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Refreshing network info cache for port 45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:58:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Creating config drive at /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk.config
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzknf7b68 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025127.6673234, da915cb7-8ab5-4c65-928f-70e94811dd4e => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:47 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] VM Resumed (Lifecycle Event)
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzknf7b68" returned: 0 in 0.123s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-fd72a2fb-9f21-475e-af42-51485bd40f9e req-3176c606-f304-46df-94f4-3904671fee82 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fd72a2fb-9f21-475e-af42-51485bd40f9e req-3176c606-f304-46df-94f4-3904671fee82 service nova] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fd72a2fb-9f21-475e-af42-51485bd40f9e req-3176c606-f304-46df-94f4-3904671fee82 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fd72a2fb-9f21-475e-af42-51485bd40f9e req-3176c606-f304-46df-94f4-3904671fee82 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-fd72a2fb-9f21-475e-af42-51485bd40f9e req-3176c606-f304-46df-94f4-3904671fee82 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] No waiting events found dispatching network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:47 user nova-compute[73254]: WARNING nova.compute.manager [req-fd72a2fb-9f21-475e-af42-51485bd40f9e req-3176c606-f304-46df-94f4-3904671fee82 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received unexpected event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c for instance with vm_state active and task_state None.
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Instance spawned successfully.
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:58:47 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025127.6956537, da915cb7-8ab5-4c65-928f-70e94811dd4e => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:47 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] VM Started (Lifecycle Event)
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:47 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:47 user nova-compute[73254]: INFO nova.compute.manager [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Took 11.89 seconds to spawn the instance on the hypervisor.
Aug 14 14:58:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:48 user nova-compute[73254]: INFO nova.compute.manager [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Took 14.37 seconds to build instance.
Aug 14 14:58:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-20a87ad6-b343-4313-afba-7cf72daf95cc tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.882s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:48 user nova-compute[73254]: DEBUG nova.network.neutron [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updated VIF entry in instance network info cache for port 45d7f56d-49d0-40e6-9d49-768c55a51b61. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:58:48 user nova-compute[73254]: DEBUG nova.network.neutron [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updating instance_info_cache with network_info: [{"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-429036ec-b871-4baa-aa6f-6c957bd44bc7 req-8b1f2429-6d61-4926-b616-92727de3742f service nova] Releasing lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-c18ae9d5-c40b-44a1-9aa8-0835ffec7a9f req-98f1adb9-4edd-452a-b4ea-412bb059d420 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received event network-vif-plugged-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c18ae9d5-c40b-44a1-9aa8-0835ffec7a9f req-98f1adb9-4edd-452a-b4ea-412bb059d420 service nova] Acquiring lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c18ae9d5-c40b-44a1-9aa8-0835ffec7a9f req-98f1adb9-4edd-452a-b4ea-412bb059d420 service nova] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c18ae9d5-c40b-44a1-9aa8-0835ffec7a9f req-98f1adb9-4edd-452a-b4ea-412bb059d420 service nova] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-c18ae9d5-c40b-44a1-9aa8-0835ffec7a9f req-98f1adb9-4edd-452a-b4ea-412bb059d420 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] No waiting events found dispatching network-vif-plugged-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:49 user nova-compute[73254]: WARNING nova.compute.manager [req-c18ae9d5-c40b-44a1-9aa8-0835ffec7a9f req-98f1adb9-4edd-452a-b4ea-412bb059d420 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received unexpected event network-vif-plugged-76fee70f-931e-4f07-97c3-038f881fbaf3 for instance with vm_state building and task_state spawning.
Aug 14 14:58:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-132189cd-4a18-4fcb-ab12-50ed92237afa req-e81c050b-6aef-4856-b4c8-9cd5b24cbf5e service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-132189cd-4a18-4fcb-ab12-50ed92237afa req-e81c050b-6aef-4856-b4c8-9cd5b24cbf5e service nova] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-132189cd-4a18-4fcb-ab12-50ed92237afa req-e81c050b-6aef-4856-b4c8-9cd5b24cbf5e service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-132189cd-4a18-4fcb-ab12-50ed92237afa req-e81c050b-6aef-4856-b4c8-9cd5b24cbf5e service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-132189cd-4a18-4fcb-ab12-50ed92237afa req-e81c050b-6aef-4856-b4c8-9cd5b24cbf5e service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] No waiting events found dispatching network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:49 user nova-compute[73254]: WARNING nova.compute.manager [req-132189cd-4a18-4fcb-ab12-50ed92237afa req-e81c050b-6aef-4856-b4c8-9cd5b24cbf5e service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received unexpected event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c for instance with vm_state active and task_state None.
Aug 14 14:58:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-f9742cd2-8dcb-4d14-b033-ba8a9fe7b663 req-589084c9-083a-45d8-9342-1097ffc29458 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received event network-vif-plugged-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f9742cd2-8dcb-4d14-b033-ba8a9fe7b663 req-589084c9-083a-45d8-9342-1097ffc29458 service nova] Acquiring lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f9742cd2-8dcb-4d14-b033-ba8a9fe7b663 req-589084c9-083a-45d8-9342-1097ffc29458 service nova] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f9742cd2-8dcb-4d14-b033-ba8a9fe7b663 req-589084c9-083a-45d8-9342-1097ffc29458 service nova] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-f9742cd2-8dcb-4d14-b033-ba8a9fe7b663 req-589084c9-083a-45d8-9342-1097ffc29458 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] No waiting events found dispatching network-vif-plugged-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:51 user nova-compute[73254]: WARNING nova.compute.manager [req-f9742cd2-8dcb-4d14-b033-ba8a9fe7b663 req-589084c9-083a-45d8-9342-1097ffc29458 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received unexpected event network-vif-plugged-76fee70f-931e-4f07-97c3-038f881fbaf3 for instance with vm_state building and task_state spawning.
Aug 14 14:58:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:58:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.claims [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Claim successful on node user
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025133.2944088, fe35bcec-a10d-4554-8cd7-1a9d1a72f484 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] VM Resumed (Lifecycle Event)
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Instance spawned successfully.
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025133.2967784, fe35bcec-a10d-4554-8cd7-1a9d1a72f484 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] VM Started (Lifecycle Event)
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Took 11.37 seconds to spawn the instance on the hypervisor.
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025133.5731869, 2d7ac783-716a-4c23-9466-fa7d5eae73a8 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] VM Resumed (Lifecycle Event)
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Instance spawned successfully.
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025133.573575, 2d7ac783-716a-4c23-9466-fa7d5eae73a8 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] VM Started (Lifecycle Event)
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Took 12.89 seconds to build instance.
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ad498280-6992-48ea-a9be-f0df7df42caf tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.121s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Took 9.77 seconds to spawn the instance on the hypervisor.
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:58:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.761s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.network.neutron [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:58:53 user nova-compute[73254]: INFO nova.compute.manager [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Took 11.24 seconds to build instance.
Aug 14 14:58:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:58:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-99ada066-d8e2-491d-988c-5dfbdaff980b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.427s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:54 user nova-compute[73254]: INFO nova.virt.block_device [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Booting with volume 5de596b1-5e07-4efd-986b-2e7161d89cb8 at /dev/vda
Aug 14 14:58:54 user nova-compute[73254]: DEBUG nova.policy [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '39db94ce446a44e6941ad7c0b7eab92d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96039e862a54a568460bdc32c225857', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:58:54 user nova-compute[73254]: DEBUG os_brick.utils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:58:54 user nova-compute[73254]: INFO oslo.privsep.daemon [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp58tlihox/privsep.sock']
Aug 14 14:58:54 user sudo[84083]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp58tlihox/privsep.sock
Aug 14 14:58:54 user sudo[84083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 14 14:58:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:58:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:58:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG nova.network.neutron [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Successfully created port: ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-7a93ff31-5f80-4d9a-ae00-e3f63a899f4f req-f0871aa0-deb6-4054-8d06-a822fc717abd service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received event network-vif-plugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7a93ff31-5f80-4d9a-ae00-e3f63a899f4f req-f0871aa0-deb6-4054-8d06-a822fc717abd service nova] Acquiring lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7a93ff31-5f80-4d9a-ae00-e3f63a899f4f req-f0871aa0-deb6-4054-8d06-a822fc717abd service nova] Lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7a93ff31-5f80-4d9a-ae00-e3f63a899f4f req-f0871aa0-deb6-4054-8d06-a822fc717abd service nova] Lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-7a93ff31-5f80-4d9a-ae00-e3f63a899f4f req-f0871aa0-deb6-4054-8d06-a822fc717abd service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] No waiting events found dispatching network-vif-plugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:55 user nova-compute[73254]: WARNING nova.compute.manager [req-7a93ff31-5f80-4d9a-ae00-e3f63a899f4f req-f0871aa0-deb6-4054-8d06-a822fc717abd service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received unexpected event network-vif-plugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 for instance with vm_state active and task_state None.
Aug 14 14:58:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:58:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json" returned: 0 in 0.373s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:56 user sudo[84083]: pam_unix(sudo:session): session closed for user root
Aug 14 14:58:56 user nova-compute[73254]: INFO oslo.privsep.daemon [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Spawned new privsep daemon via rootwrap
Aug 14 14:58:56 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 14 14:58:56 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 14 14:58:56 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 14 14:58:56 user nova-compute[73254]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84090
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[da342744-1bca-4bae-b496-0b4cbc4326fe]: (2,) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[58001b81-0fe8-4b93-af72-705f6e5ee0f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:58:56 user nova-compute[73254]: WARNING os_brick.initiator.connectors.nvmeof [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.035s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[351006b7-401e-4936-8951-2b6cbd2f011c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f1a75-5eda-4ea8-aa15-bfeb4e004426]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0c8b2d-395a-45b9-900b-b8131602ab4f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:58:57 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ea3801-b663-4ee8-b024-27a7a807b8f4]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG os_brick.utils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] <== get_connector_properties: return (2942ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Updating existing volume attachment record: 03fdf341-fc8c-4863-b6ed-7e3bee3b2296 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.network.neutron [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Successfully updated port: ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "refresh_cache-0674641b-1cd6-43ba-9970-f3cdd88a2b59" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquired lock "refresh_cache-0674641b-1cd6-43ba-9970-f3cdd88a2b59" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.network.neutron [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received event network-vif-plugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Acquiring lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] No waiting events found dispatching network-vif-plugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:57 user nova-compute[73254]: WARNING nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received unexpected event network-vif-plugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 for instance with vm_state active and task_state None.
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-vif-plugged-45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] No waiting events found dispatching network-vif-plugged-45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:57 user nova-compute[73254]: WARNING nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received unexpected event network-vif-plugged-45d7f56d-49d0-40e6-9d49-768c55a51b61 for instance with vm_state active and task_state None.
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-vif-plugged-45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] No waiting events found dispatching network-vif-plugged-45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:58:57 user nova-compute[73254]: WARNING nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received unexpected event network-vif-plugged-45d7f56d-49d0-40e6-9d49-768c55a51b61 for instance with vm_state active and task_state None.
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-changed-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Refreshing instance network info cache due to event network-changed-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Acquiring lock "refresh_cache-0674641b-1cd6-43ba-9970-f3cdd88a2b59" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.network.neutron [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.network.neutron [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Updating instance_info_cache with network_info: [{"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Releasing lock "refresh_cache-0674641b-1cd6-43ba-9970-f3cdd88a2b59" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Instance network_info: |[{"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Acquired lock "refresh_cache-0674641b-1cd6-43ba-9970-f3cdd88a2b59" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:58:57 user nova-compute[73254]: DEBUG nova.network.neutron [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Refreshing network info cache for port ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG nova.network.neutron [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Updated VIF entry in instance network info cache for port ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG nova.network.neutron [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Updating instance_info_cache with network_info: [{"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-529e5790-3c22-454c-bace-3356a9fd60fa req-2f13b5f0-87e2-4d18-bb80-b73a8167f856 service nova] Releasing lock "refresh_cache-0674641b-1cd6-43ba-9970-f3cdd88a2b59" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:58:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:58:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:00 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:59:00 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:59:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7721MB free_disk=25.794166564941406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 14:59:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 16996b6c-6d6e-4b51-88f3-0ca024e95639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0110dafc-b336-45bd-aade-0eb9ba632a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c07824af-f4a5-4018-a1e5-40cb58643bc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 94250a67-88b2-48ac-88ad-8b298cf66692 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance da915cb7-8ab5-4c65-928f-70e94811dd4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance fe35bcec-a10d-4554-8cd7-1a9d1a72f484 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 2d7ac783-716a-4c23-9466-fa7d5eae73a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0674641b-1cd6-43ba-9970-f3cdd88a2b59 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 14:59:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.818s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:59:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 14:59:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 14:59:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Skipping network cache update for instance because it is Building. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 14:59:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:02 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 14:59:02 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 16996b6c-6d6e-4b51-88f3-0ca024e95639 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:59:03 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Updating instance_info_cache with network_info: [{"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 14:59:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:59:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:59:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:59:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:59:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:59:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Creating image(s)
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Ensure instance console log exists: /opt/stack/data/nova/instances/0674641b-1cd6-43ba-9970-f3cdd88a2b59/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Start _get_guest_xml network_info=[{"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '03fdf341-fc8c-4863-b6ed-7e3bee3b2296', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLqsucOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0674641b-1cd6-43ba-9970-f3cdd88a2b59', 'attached_at': '', 'detached_at': '', 'volume_id': '5de596b1-5e07-4efd-986b-2e7161d89cb8', 'serial': '5de596b1-5e07-4efd-986b-2e7161d89cb8'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:59:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:59:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG os_brick.initiator.connector [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Factory for ISCSI on None {{(pid=73254) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLqsucOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:59:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:59:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:59:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:59:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:59:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:59:08 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:59:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[657a6ee7-f686-4dfa-9b97-a9892d370da6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:59:09 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1935a1be-bf7c-4a7f-af81-216d70612e1b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8] added
Aug 14 14:59:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[02455b4f-98bf-4d7e-9e3a-badded578677]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3999fef6-d69c-4984-ad97-eb3de256f7bd]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLqsucOV {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLqsucOV" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1301e351-3eb8-4cd7-a389-ba6cc5a9c8aa]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XLqsucOV'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe78308-b2f6-430d-8162-ec2ef6b806f9]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[540505db-7924-436c-84e6-20b7bc88b8e1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:59:09 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 14:59:09 user nova-compute[73254]:  {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:59:09 user nova-compute[73254]: WARNING os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 14:59:09 user nova-compute[73254]: 
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b958f5ae-ace6-4114-b57d-288b70269967]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260]
Aug 14 14:59:09 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260] successful.
Aug 14 14:59:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5913847-964b-4111-8456-a4928c72d997]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9470ab-dec2-4616-82c3-0096d9c279da]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e682436-95c1-49d2-ac46-793ea7861aab]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:59:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLqsucOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23835613132623436', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835613132623436', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1973214659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1973214659',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFl33XV+x9ts4rv7WJNVvYshjSa8TNqiIrMQzBrp0O6ibe77tIbQntCMYwdBaWlciKrpx8xErIU9j4DjFDlicSBbUrowd40KRU/vV0pPoHS0beUaHWL5ciQBFkq3LACXTg==',key_name='tempest-keypair-1229858273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96039e862a54a568460bdc32c225857',ramdisk_id='',reservation_id='r-ta92if1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-446563179',owner_user_name='tempest-ServerActionsV293TestJSON-446563179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39db94ce446a44e6941ad7c0b7eab92d',uuid=0674641b-1cd6-43ba-9970-f3cdd88a2b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converting VIF {"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.objects.instance [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lazy-loading 'pci_devices' on Instance uuid 0674641b-1cd6-43ba-9970-f3cdd88a2b59 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:59:10 user nova-compute[73254]:   <uuid>0674641b-1cd6-43ba-9970-f3cdd88a2b59</uuid>
Aug 14 14:59:10 user nova-compute[73254]:   <name>instance-00000009</name>
Aug 14 14:59:10 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:59:10 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:59:10 user nova-compute[73254]:   <metadata>
Aug 14 14:59:10 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:59:10 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:59:10 user nova-compute[73254]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1973214659</nova:name>
Aug 14 14:59:10 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:59:08</nova:creationTime>
Aug 14 14:59:10 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:59:10 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:59:10 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:59:10 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:59:10 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:59:10 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:59:10 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:59:10 user nova-compute[73254]:       <nova:owner>
Aug 14 14:59:10 user nova-compute[73254]:         <nova:user uuid="39db94ce446a44e6941ad7c0b7eab92d">tempest-ServerActionsV293TestJSON-446563179-project-member</nova:user>
Aug 14 14:59:10 user nova-compute[73254]:         <nova:project uuid="b96039e862a54a568460bdc32c225857">tempest-ServerActionsV293TestJSON-446563179</nova:project>
Aug 14 14:59:10 user nova-compute[73254]:       </nova:owner>
Aug 14 14:59:10 user nova-compute[73254]:       <nova:ports>
Aug 14 14:59:10 user nova-compute[73254]:         <nova:port uuid="ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36">
Aug 14 14:59:10 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 14:59:10 user nova-compute[73254]:         </nova:port>
Aug 14 14:59:10 user nova-compute[73254]:       </nova:ports>
Aug 14 14:59:10 user nova-compute[73254]:     </nova:instance>
Aug 14 14:59:10 user nova-compute[73254]:   </metadata>
Aug 14 14:59:10 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:59:10 user nova-compute[73254]:     <system>
Aug 14 14:59:10 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:59:10 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:59:10 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:59:10 user nova-compute[73254]:       <entry name="serial">0674641b-1cd6-43ba-9970-f3cdd88a2b59</entry>
Aug 14 14:59:10 user nova-compute[73254]:       <entry name="uuid">0674641b-1cd6-43ba-9970-f3cdd88a2b59</entry>
Aug 14 14:59:10 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:59:10 user nova-compute[73254]:     </system>
Aug 14 14:59:10 user nova-compute[73254]:   </sysinfo>
Aug 14 14:59:10 user nova-compute[73254]:   <os>
Aug 14 14:59:10 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:59:10 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:59:10 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:59:10 user nova-compute[73254]:   </os>
Aug 14 14:59:10 user nova-compute[73254]:   <features>
Aug 14 14:59:10 user nova-compute[73254]:     <acpi/>
Aug 14 14:59:10 user nova-compute[73254]:     <apic/>
Aug 14 14:59:10 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:59:10 user nova-compute[73254]:   </features>
Aug 14 14:59:10 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:59:10 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:59:10 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:59:10 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:59:10 user nova-compute[73254]:   </clock>
Aug 14 14:59:10 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:59:10 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:59:10 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:59:10 user nova-compute[73254]:   </cpu>
Aug 14 14:59:10 user nova-compute[73254]:   <devices>
Aug 14 14:59:10 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 14:59:10 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:59:10 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 14:59:10 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:59:10 user nova-compute[73254]:       <serial>5de596b1-5e07-4efd-986b-2e7161d89cb8</serial>
Aug 14 14:59:10 user nova-compute[73254]:     </disk>
Aug 14 14:59:10 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:59:10 user nova-compute[73254]:       <mac address="fa:16:3e:f4:f8:9a"/>
Aug 14 14:59:10 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:10 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:59:10 user nova-compute[73254]:       <target dev="tapac8d1a73-4e"/>
Aug 14 14:59:10 user nova-compute[73254]:     </interface>
Aug 14 14:59:10 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:59:10 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/0674641b-1cd6-43ba-9970-f3cdd88a2b59/console.log" append="off"/>
Aug 14 14:59:10 user nova-compute[73254]:     </serial>
Aug 14 14:59:10 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:59:10 user nova-compute[73254]:     <video>
Aug 14 14:59:10 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:10 user nova-compute[73254]:     </video>
Aug 14 14:59:10 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:59:10 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:59:10 user nova-compute[73254]:     </rng>
Aug 14 14:59:10 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:59:10 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:59:10 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:59:10 user nova-compute[73254]:     </memballoon>
Aug 14 14:59:10 user nova-compute[73254]:   </devices>
Aug 14 14:59:10 user nova-compute[73254]: </domain>
Aug 14 14:59:10 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1973214659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1973214659',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFl33XV+x9ts4rv7WJNVvYshjSa8TNqiIrMQzBrp0O6ibe77tIbQntCMYwdBaWlciKrpx8xErIU9j4DjFDlicSBbUrowd40KRU/vV0pPoHS0beUaHWL5ciQBFkq3LACXTg==',key_name='tempest-keypair-1229858273',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b96039e862a54a568460bdc32c225857',ramdisk_id='',reservation_id='r-ta92if1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-446563179',owner_user_name='tempest-ServerActionsV293TestJSON-446563179-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39db94ce446a44e6941ad7c0b7eab92d',uuid=0674641b-1cd6-43ba-9970-f3cdd88a2b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converting VIF {"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG os_vif [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac8d1a73-4e, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac8d1a73-4e, col_values=(('external_ids', {'iface-id': 'ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:f8:9a', 'vm-uuid': '0674641b-1cd6-43ba-9970-f3cdd88a2b59'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:10 user nova-compute[73254]: INFO os_vif [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e')
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] No VIF found with MAC fa:16:3e:f4:f8:9a, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:59:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-ea7324e9-c6fe-4f85-b1aa-9d28acc905c9 req-2c2e76d4-485a-4038-bc6b-c5efbf3b4d64 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ea7324e9-c6fe-4f85-b1aa-9d28acc905c9 req-2c2e76d4-485a-4038-bc6b-c5efbf3b4d64 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ea7324e9-c6fe-4f85-b1aa-9d28acc905c9 req-2c2e76d4-485a-4038-bc6b-c5efbf3b4d64 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ea7324e9-c6fe-4f85-b1aa-9d28acc905c9 req-2c2e76d4-485a-4038-bc6b-c5efbf3b4d64 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-ea7324e9-c6fe-4f85-b1aa-9d28acc905c9 req-2c2e76d4-485a-4038-bc6b-c5efbf3b4d64 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No waiting events found dispatching network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:59:12 user nova-compute[73254]: WARNING nova.compute.manager [req-ea7324e9-c6fe-4f85-b1aa-9d28acc905c9 req-2c2e76d4-485a-4038-bc6b-c5efbf3b4d64 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state building and task_state spawning.
Aug 14 14:59:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025154.17226, 0674641b-1cd6-43ba-9970-f3cdd88a2b59 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:59:14 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] VM Resumed (Lifecycle Event)
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:59:14 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Instance spawned successfully.
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:14 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025154.173499, 0674641b-1cd6-43ba-9970-f3cdd88a2b59 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:59:14 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] VM Started (Lifecycle Event)
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:59:14 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:59:14 user nova-compute[73254]: INFO nova.compute.manager [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Took 5.43 seconds to spawn the instance on the hypervisor.
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-8d14fee7-201e-411d-a4f9-d24fe14cbc4e req-e56552c6-3758-4400-9b5e-39218fa1033c service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8d14fee7-201e-411d-a4f9-d24fe14cbc4e req-e56552c6-3758-4400-9b5e-39218fa1033c service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8d14fee7-201e-411d-a4f9-d24fe14cbc4e req-e56552c6-3758-4400-9b5e-39218fa1033c service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8d14fee7-201e-411d-a4f9-d24fe14cbc4e req-e56552c6-3758-4400-9b5e-39218fa1033c service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-8d14fee7-201e-411d-a4f9-d24fe14cbc4e req-e56552c6-3758-4400-9b5e-39218fa1033c service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No waiting events found dispatching network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:59:14 user nova-compute[73254]: WARNING nova.compute.manager [req-8d14fee7-201e-411d-a4f9-d24fe14cbc4e req-e56552c6-3758-4400-9b5e-39218fa1033c service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state building and task_state spawning.
Aug 14 14:59:14 user nova-compute[73254]: INFO nova.compute.manager [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Took 21.39 seconds to build instance.
Aug 14 14:59:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3fc509d3-fdc7-49ee-9877-3edd2c4f8b71 tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.534s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "fd27da65-077e-4bd1-83fa-350928ca1478" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:59:21 user nova-compute[73254]: INFO nova.compute.claims [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Claim successful on node user
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:59:21 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:59:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:59:21 user nova-compute[73254]: INFO nova.virt.block_device [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Booting with volume 5e36db3d-04db-475b-8d2e-8afd9656594e at /dev/vda
Aug 14 14:59:22 user nova-compute[73254]: DEBUG os_brick.utils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c212f3a3-ddd3-460c-971f-c880da75b63a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[95edbfd7-8070-4b42-a399-2e51b40bb8f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG nova.policy [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd4b513a9757044a98bf3b1f726117e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '811e73c9bf0a45179efab5cdaced116b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c59086-8388-46b4-8c69-c839a4c51703]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[26eee31d-2730-4651-8ecc-553752e7fb36]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:59:22 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:59:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db75f7c-12bb-465d-88e2-c60194be14fe]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG os_brick.utils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating existing volume attachment record: 142e643f-625a-410c-8e8e-da0fb6101d27 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:59:22 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully created port: 2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:59:23 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully created port: 51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:59:24 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully created port: 74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:59:24 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully created port: 3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:59:25 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully created port: c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:59:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:26 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully updated port: 2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:59:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-8ceb586f-c5d7-4a7a-aa57-ca3566e7cd97 req-be48f421-2c71-40d0-bc62-6af337aa2210 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-changed-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-8ceb586f-c5d7-4a7a-aa57-ca3566e7cd97 req-be48f421-2c71-40d0-bc62-6af337aa2210 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing instance network info cache due to event network-changed-2eaf6d44-2959-46a2-8439-9d1774481a00. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:59:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8ceb586f-c5d7-4a7a-aa57-ca3566e7cd97 req-be48f421-2c71-40d0-bc62-6af337aa2210 service nova] Acquiring lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8ceb586f-c5d7-4a7a-aa57-ca3566e7cd97 req-be48f421-2c71-40d0-bc62-6af337aa2210 service nova] Acquired lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:26 user nova-compute[73254]: DEBUG nova.network.neutron [req-8ceb586f-c5d7-4a7a-aa57-ca3566e7cd97 req-be48f421-2c71-40d0-bc62-6af337aa2210 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing network info cache for port 2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:59:26 user nova-compute[73254]: DEBUG nova.network.neutron [req-8ceb586f-c5d7-4a7a-aa57-ca3566e7cd97 req-be48f421-2c71-40d0-bc62-6af337aa2210 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:59:26 user nova-compute[73254]: DEBUG nova.network.neutron [req-8ceb586f-c5d7-4a7a-aa57-ca3566e7cd97 req-be48f421-2c71-40d0-bc62-6af337aa2210 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8ceb586f-c5d7-4a7a-aa57-ca3566e7cd97 req-be48f421-2c71-40d0-bc62-6af337aa2210 service nova] Releasing lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:27 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully updated port: 75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:59:27 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully updated port: 1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-changed-75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing instance network info cache due to event network-changed-75c5a7e8-55ff-4d62-938c-2d2cea41507c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] Acquiring lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] Acquired lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG nova.network.neutron [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing network info cache for port 75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG nova.network.neutron [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG nova.network.neutron [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] Releasing lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-changed-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing instance network info cache due to event network-changed-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] Acquiring lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] Acquired lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG nova.network.neutron [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing network info cache for port 1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully updated port: 51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:59:28 user nova-compute[73254]: DEBUG nova.network.neutron [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG nova.network.neutron [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-910e3289-5a66-46b4-a874-839504a75e9a req-197c509b-d64a-4183-a57a-0052725335a8 service nova] Releasing lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully updated port: 74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-8c1a2370-f38f-4590-85dd-e617bbcc0318 req-afee4cfd-e558-49d4-a2a1-42f5413204d4 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-changed-74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-8c1a2370-f38f-4590-85dd-e617bbcc0318 req-afee4cfd-e558-49d4-a2a1-42f5413204d4 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing instance network info cache due to event network-changed-74253df8-144f-4a08-9379-bc9175400d53. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8c1a2370-f38f-4590-85dd-e617bbcc0318 req-afee4cfd-e558-49d4-a2a1-42f5413204d4 service nova] Acquiring lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8c1a2370-f38f-4590-85dd-e617bbcc0318 req-afee4cfd-e558-49d4-a2a1-42f5413204d4 service nova] Acquired lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG nova.network.neutron [req-8c1a2370-f38f-4590-85dd-e617bbcc0318 req-afee4cfd-e558-49d4-a2a1-42f5413204d4 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing network info cache for port 74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG nova.network.neutron [req-8c1a2370-f38f-4590-85dd-e617bbcc0318 req-afee4cfd-e558-49d4-a2a1-42f5413204d4 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG nova.network.neutron [req-8c1a2370-f38f-4590-85dd-e617bbcc0318 req-afee4cfd-e558-49d4-a2a1-42f5413204d4 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8c1a2370-f38f-4590-85dd-e617bbcc0318 req-afee4cfd-e558-49d4-a2a1-42f5413204d4 service nova] Releasing lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully updated port: 3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-62b03f50-1930-4b2b-ada2-97ad02ed7ab0 req-f0fff42e-7ca5-40f5-a89d-2286e981f3eb service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-changed-51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-62b03f50-1930-4b2b-ada2-97ad02ed7ab0 req-f0fff42e-7ca5-40f5-a89d-2286e981f3eb service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing instance network info cache due to event network-changed-51b6eb3b-b190-4421-880e-846dce087fe2. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-62b03f50-1930-4b2b-ada2-97ad02ed7ab0 req-f0fff42e-7ca5-40f5-a89d-2286e981f3eb service nova] Acquiring lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-62b03f50-1930-4b2b-ada2-97ad02ed7ab0 req-f0fff42e-7ca5-40f5-a89d-2286e981f3eb service nova] Acquired lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG nova.network.neutron [req-62b03f50-1930-4b2b-ada2-97ad02ed7ab0 req-f0fff42e-7ca5-40f5-a89d-2286e981f3eb service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing network info cache for port 51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG nova.network.neutron [req-62b03f50-1930-4b2b-ada2-97ad02ed7ab0 req-f0fff42e-7ca5-40f5-a89d-2286e981f3eb service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG nova.network.neutron [req-62b03f50-1930-4b2b-ada2-97ad02ed7ab0 req-f0fff42e-7ca5-40f5-a89d-2286e981f3eb service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-62b03f50-1930-4b2b-ada2-97ad02ed7ab0 req-f0fff42e-7ca5-40f5-a89d-2286e981f3eb service nova] Releasing lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Successfully updated port: c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquired lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:30 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:59:31 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:59:31 user nova-compute[73254]: DEBUG nova.compute.manager [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-changed-3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:31 user nova-compute[73254]: DEBUG nova.compute.manager [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing instance network info cache due to event network-changed-3b4b50f8-90fa-4a58-8381-240f5ab9e860. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:59:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] Acquiring lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:32 user nova-compute[73254]: INFO nova.virt.block_device [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Booting with volume 23e4a28b-2368-4b63-a629-ed7ef5615f91 at /dev/vdb
Aug 14 14:59:32 user nova-compute[73254]: DEBUG os_brick.utils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[897dbc0f-89dd-4d1a-90dd-6afce7959f74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[691fd0cb-6484-42fe-91c2-1604c0ca47ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0649d4-095a-49e2-95cd-39a4c0580a19]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fb884f-f088-4c78-b953-b9c2cf42b400]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:59:32 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:59:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5994c328-bc48-40df-b0ff-9a4d9ea83794]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG os_brick.utils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:59:32 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating existing volume attachment record: 39eebb01-0942-4086-99c7-0a3642f9c3e5 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [{"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Releasing lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Instance network_info: |[{"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] Acquired lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing network info cache for port 3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updated VIF entry in instance network info cache for port 3b4b50f8-90fa-4a58-8381-240f5ab9e860. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [{"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] Releasing lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-changed-c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing instance network info cache due to event network-changed-c2b94e12-77ee-4db0-bcbd-921903a8f883. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] Acquiring lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] Acquired lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing network info cache for port c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:59:34 user nova-compute[73254]: DEBUG nova.network.neutron [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updated VIF entry in instance network info cache for port c2b94e12-77ee-4db0-bcbd-921903a8f883. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:59:34 user nova-compute[73254]: DEBUG nova.network.neutron [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [{"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-82203cca-76b6-406d-ba1b-1d07c9cc98e0 req-67958327-300f-4528-9cbf-63826cd061d8 service nova] Releasing lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:41 user nova-compute[73254]: INFO nova.virt.block_device [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Booting with volume 5b748f02-008f-4901-8c7e-1a6257dd9ef8 at /dev/vdc
Aug 14 14:59:41 user nova-compute[73254]: DEBUG os_brick.utils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[796f6c7a-7444-4939-aa6e-b53310b5fe99]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[972530eb-419e-41b7-9a43-86663f20aa3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1073e49-05e7-4e9e-9dee-c36b8d21229a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30a4027-6cad-4316-987b-c2e659477186]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 14:59:41 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 14:59:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2754d0dd-d9c3-4f79-b8e0-a33013584fb0]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG os_brick.utils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:59:41 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating existing volume attachment record: b6e2774c-8ea5-4852-bb0a-1fe2c17b9eb9 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 14:59:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:59:49 user nova-compute[73254]: INFO nova.compute.claims [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Claim successful on node user
Aug 14 14:59:49 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG nova.network.neutron [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:59:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:59:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG nova.policy [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '473f1026828f41cc810fb66cf3715daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7178e5b9b71a485ca1341c171795379e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:59:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Creating image(s)
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "/opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "/opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.193s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk 1073741824" returned: 0 in 0.047s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Successfully created port: b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Cannot resize image /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'migration_context' on Instance uuid 4b878d88-e5f3-41b9-a399-c2da1806e1fc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Ensure instance console log exists: /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Successfully updated port: b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquired lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-b0206bdd-fafb-43f3-9c6d-8212560cd517 req-aa736b16-0aff-4d8a-8e27-9560b18a55fd service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-changed-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-b0206bdd-fafb-43f3-9c6d-8212560cd517 req-aa736b16-0aff-4d8a-8e27-9560b18a55fd service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Refreshing instance network info cache due to event network-changed-b2e5b202-0340-415c-940e-e8111a13d8fe. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:59:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b0206bdd-fafb-43f3-9c6d-8212560cd517 req-aa736b16-0aff-4d8a-8e27-9560b18a55fd service nova] Acquiring lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updating instance_info_cache with network_info: [{"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Releasing lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Instance network_info: |[{"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b0206bdd-fafb-43f3-9c6d-8212560cd517 req-aa736b16-0aff-4d8a-8e27-9560b18a55fd service nova] Acquired lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-b0206bdd-fafb-43f3-9c6d-8212560cd517 req-aa736b16-0aff-4d8a-8e27-9560b18a55fd service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Refreshing network info cache for port b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Start _get_guest_xml network_info=[{"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:59:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:59:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1177744398',display_name='tempest-TestStampPattern-server-1177744398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1177744398',id=11,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaEzkBahIJ840YexSkejfPgB8Zu9IUTn4OhhFXFVyR7pO7f5lGzuSbxZ+sWUWa5xUvNWxRoCjcERWwoKcS9+q8odyZhEZxgpj4xugZIhdTa72+xL2CIyBYVuUyoIrEWBQ==',key_name='tempest-TestStampPattern-568033608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7178e5b9b71a485ca1341c171795379e',ramdisk_id='',reservation_id='r-udam57wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1384631137',owner_user_name='tempest-TestStampPattern-1384631137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:50Z,user_data=None,user_id='473f1026828f41cc810fb66cf3715daf',uuid=4b878d88-e5f3-41b9-a399-c2da1806e1fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converting VIF {"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7e:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2e5b202-0340-415c-940e-e8111a13d8fe,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e5b202-03') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b878d88-e5f3-41b9-a399-c2da1806e1fc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:59:51 user nova-compute[73254]:   <uuid>4b878d88-e5f3-41b9-a399-c2da1806e1fc</uuid>
Aug 14 14:59:51 user nova-compute[73254]:   <name>instance-0000000b</name>
Aug 14 14:59:51 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:59:51 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:59:51 user nova-compute[73254]:   <metadata>
Aug 14 14:59:51 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:59:51 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:59:51 user nova-compute[73254]:       <nova:name>tempest-TestStampPattern-server-1177744398</nova:name>
Aug 14 14:59:51 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:59:51</nova:creationTime>
Aug 14 14:59:51 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:59:51 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:59:51 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:59:51 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:59:51 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:59:51 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:59:51 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:59:51 user nova-compute[73254]:       <nova:owner>
Aug 14 14:59:51 user nova-compute[73254]:         <nova:user uuid="473f1026828f41cc810fb66cf3715daf">tempest-TestStampPattern-1384631137-project-member</nova:user>
Aug 14 14:59:51 user nova-compute[73254]:         <nova:project uuid="7178e5b9b71a485ca1341c171795379e">tempest-TestStampPattern-1384631137</nova:project>
Aug 14 14:59:51 user nova-compute[73254]:       </nova:owner>
Aug 14 14:59:51 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 14:59:51 user nova-compute[73254]:       <nova:ports>
Aug 14 14:59:51 user nova-compute[73254]:         <nova:port uuid="b2e5b202-0340-415c-940e-e8111a13d8fe">
Aug 14 14:59:51 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 14:59:51 user nova-compute[73254]:         </nova:port>
Aug 14 14:59:51 user nova-compute[73254]:       </nova:ports>
Aug 14 14:59:51 user nova-compute[73254]:     </nova:instance>
Aug 14 14:59:51 user nova-compute[73254]:   </metadata>
Aug 14 14:59:51 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:59:51 user nova-compute[73254]:     <system>
Aug 14 14:59:51 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:59:51 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:59:51 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:59:51 user nova-compute[73254]:       <entry name="serial">4b878d88-e5f3-41b9-a399-c2da1806e1fc</entry>
Aug 14 14:59:51 user nova-compute[73254]:       <entry name="uuid">4b878d88-e5f3-41b9-a399-c2da1806e1fc</entry>
Aug 14 14:59:51 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:59:51 user nova-compute[73254]:     </system>
Aug 14 14:59:51 user nova-compute[73254]:   </sysinfo>
Aug 14 14:59:51 user nova-compute[73254]:   <os>
Aug 14 14:59:51 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:59:51 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:59:51 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:59:51 user nova-compute[73254]:   </os>
Aug 14 14:59:51 user nova-compute[73254]:   <features>
Aug 14 14:59:51 user nova-compute[73254]:     <acpi/>
Aug 14 14:59:51 user nova-compute[73254]:     <apic/>
Aug 14 14:59:51 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:59:51 user nova-compute[73254]:   </features>
Aug 14 14:59:51 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:59:51 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:59:51 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:59:51 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:59:51 user nova-compute[73254]:   </clock>
Aug 14 14:59:51 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:59:51 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:59:51 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:59:51 user nova-compute[73254]:   </cpu>
Aug 14 14:59:51 user nova-compute[73254]:   <devices>
Aug 14 14:59:51 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 14:59:51 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:59:51 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk"/>
Aug 14 14:59:51 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:59:51 user nova-compute[73254]:     </disk>
Aug 14 14:59:51 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:59:51 user nova-compute[73254]:       <mac address="fa:16:3e:cb:7e:c3"/>
Aug 14 14:59:51 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:51 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:59:51 user nova-compute[73254]:       <target dev="tapb2e5b202-03"/>
Aug 14 14:59:51 user nova-compute[73254]:     </interface>
Aug 14 14:59:51 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:59:51 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/console.log" append="off"/>
Aug 14 14:59:51 user nova-compute[73254]:     </serial>
Aug 14 14:59:51 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:59:51 user nova-compute[73254]:     <video>
Aug 14 14:59:51 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:51 user nova-compute[73254]:     </video>
Aug 14 14:59:51 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:59:51 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:59:51 user nova-compute[73254]:     </rng>
Aug 14 14:59:51 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:59:51 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:59:51 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:59:51 user nova-compute[73254]:     </memballoon>
Aug 14 14:59:51 user nova-compute[73254]:   </devices>
Aug 14 14:59:51 user nova-compute[73254]: </domain>
Aug 14 14:59:51 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1177744398',display_name='tempest-TestStampPattern-server-1177744398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1177744398',id=11,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaEzkBahIJ840YexSkejfPgB8Zu9IUTn4OhhFXFVyR7pO7f5lGzuSbxZ+sWUWa5xUvNWxRoCjcERWwoKcS9+q8odyZhEZxgpj4xugZIhdTa72+xL2CIyBYVuUyoIrEWBQ==',key_name='tempest-TestStampPattern-568033608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7178e5b9b71a485ca1341c171795379e',ramdisk_id='',reservation_id='r-udam57wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1384631137',owner_user_name='tempest-TestStampPattern-1384631137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:50Z,user_data=None,user_id='473f1026828f41cc810fb66cf3715daf',uuid=4b878d88-e5f3-41b9-a399-c2da1806e1fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converting VIF {"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7e:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2e5b202-0340-415c-940e-e8111a13d8fe,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e5b202-03') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG os_vif [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7e:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2e5b202-0340-415c-940e-e8111a13d8fe,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e5b202-03') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb2e5b202-03, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb2e5b202-03, col_values=(('external_ids', {'iface-id': 'b2e5b202-0340-415c-940e-e8111a13d8fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:7e:c3', 'vm-uuid': '4b878d88-e5f3-41b9-a399-c2da1806e1fc'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:51 user nova-compute[73254]: INFO os_vif [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:7e:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2e5b202-0340-415c-940e-e8111a13d8fe,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e5b202-03')
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] No VIF found with MAC fa:16:3e:cb:7e:c3, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-b0206bdd-fafb-43f3-9c6d-8212560cd517 req-aa736b16-0aff-4d8a-8e27-9560b18a55fd service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updated VIF entry in instance network info cache for port b2e5b202-0340-415c-940e-e8111a13d8fe. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-b0206bdd-fafb-43f3-9c6d-8212560cd517 req-aa736b16-0aff-4d8a-8e27-9560b18a55fd service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updating instance_info_cache with network_info: [{"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b0206bdd-fafb-43f3-9c6d-8212560cd517 req-aa736b16-0aff-4d8a-8e27-9560b18a55fd service nova] Releasing lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 14:59:52 user nova-compute[73254]: INFO nova.compute.claims [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Claim successful on node user
Aug 14 14:59:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.522s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.compute.manager [req-75476885-3bcf-440f-b012-2e0ede7088ab req-b9afc697-4323-467b-8499-91544b7bfedf service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-75476885-3bcf-440f-b012-2e0ede7088ab req-b9afc697-4323-467b-8499-91544b7bfedf service nova] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-75476885-3bcf-440f-b012-2e0ede7088ab req-b9afc697-4323-467b-8499-91544b7bfedf service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-75476885-3bcf-440f-b012-2e0ede7088ab req-b9afc697-4323-467b-8499-91544b7bfedf service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.compute.manager [req-75476885-3bcf-440f-b012-2e0ede7088ab req-b9afc697-4323-467b-8499-91544b7bfedf service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] No waiting events found dispatching network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:59:53 user nova-compute[73254]: WARNING nova.compute.manager [req-75476885-3bcf-440f-b012-2e0ede7088ab req-b9afc697-4323-467b-8499-91544b7bfedf service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received unexpected event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe for instance with vm_state building and task_state spawning.
Aug 14 14:59:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.policy [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f6f7c760aea49c5a2914d1dbff90077', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd3bb025095b443d822303c387f0deca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:59:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Creating image(s)
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "/opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "/opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "/opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 14:59:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Creating image(s)
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Ensure instance console log exists: /opt/stack/data/nova/instances/fd27da65-077e-4bd1-83fa-350928ca1478/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Start _get_guest_xml network_info=[{"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '142e643f-625a-410c-8e8e-da0fb6101d27', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBHJXqpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd27da65-077e-4bd1-83fa-350928ca1478', 'attached_at': '', 'detached_at': '', 'volume_id': '5e36db3d-04db-475b-8d2e-8afd9656594e', 'serial': '5e36db3d-04db-475b-8d2e-8afd9656594e'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'attachment_id': '39eebb01-0942-4086-99c7-0a3642f9c3e5', 'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjYaEIbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd27da65-077e-4bd1-83fa-350928ca1478', 'attached_at': '', 'detached_at': '', 'volume_id': '23e4a28b-2368-4b63-a629-ed7ef5615f91', 'serial': '23e4a28b-2368-4b63-a629-ed7ef5615f91'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'attachment_id': 'b6e2774c-8ea5-4852-bb0a-1fe2c17b9eb9', 'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRjlayAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fd27da65-077e-4bd1-83fa-350928ca1478', 'attached_at': '', 'detached_at': '', 'volume_id': '5b748f02-008f-4901-8c7e-1a6257dd9ef8', 'serial': '5b748f02-008f-4901-8c7e-1a6257dd9ef8'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk 1073741824" returned: 0 in 0.062s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:53 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:59:53 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBHJXqpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:59:53 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:59:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:59:53 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:59:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:59:53 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7576fef6-12c7-4bb0-b3cf-fd4ea0d9b801]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:59:53 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfc66f9-b021-454b-a349-9c63532d32b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e] added
Aug 14 14:59:53 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c65c65-ad31-40db-a220-22978f3d3508]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.171s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Checking if we can resize image /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a1fc22-671a-43ab-8baa-3e9a75b2ec49]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBHJXqpz {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBHJXqpz" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3fa753-fe37-4b85-9a57-ca9be5bcdf9b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CBHJXqpz'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8856887-6f8c-4a5c-b07e-db6760ba0eb4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb720b8-07b5-4b50-bda8-f7becec3d6ac]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aa2943-e6ad-429a-879d-3f2e168723aa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e, portal: 172.16.0.220,3260]
Aug 14 14:59:54 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e, portal: 172.16.0.220,3260] successful.
Aug 14 14:59:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Cannot resize image /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lazy-loading 'migration_context' on Instance uuid 244d32a6-c532-4e7e-84dd-b747a7a05c4b {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Ensure instance console log exists: /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f71db2b-88f6-4fd4-aeeb-dd3697e0f2bd]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Successfully created port: 8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7935ba02-ae70-408d-8445-9f11f514bc92]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:54 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 14:59:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:54 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 14:59:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f64045-1408-4926-a371-55241e19c044]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBHJXqpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Successfully updated port: 8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "refresh_cache-244d32a6-c532-4e7e-84dd-b747a7a05c4b" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquired lock "refresh_cache-244d32a6-c532-4e7e-84dd-b747a7a05c4b" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025194.9766438, 4b878d88-e5f3-41b9-a399-c2da1806e1fc => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:59:54 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] VM Resumed (Lifecycle Event)
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:59:54 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Instance spawned successfully.
Aug 14 14:59:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:55 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025194.979062, 4b878d88-e5f3-41b9-a399-c2da1806e1fc => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:59:55 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] VM Started (Lifecycle Event)
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:59:55 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:59:55 user nova-compute[73254]: INFO nova.compute.manager [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] No waiting events found dispatching network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:59:55 user nova-compute[73254]: WARNING nova.compute.manager [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received unexpected event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe for instance with vm_state building and task_state spawning.
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Received event network-changed-8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Refreshing instance network info cache due to event network-changed-8069f888-3b93-4c26-9ba8-6eb3ba6b053c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] Acquiring lock "refresh_cache-244d32a6-c532-4e7e-84dd-b747a7a05c4b" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Updating instance_info_cache with network_info: [{"id": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "address": "fa:16:3e:d5:d1:15", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8069f888-3b", "ovs_interfaceid": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Releasing lock "refresh_cache-244d32a6-c532-4e7e-84dd-b747a7a05c4b" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Instance network_info: |[{"id": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "address": "fa:16:3e:d5:d1:15", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8069f888-3b", "ovs_interfaceid": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] Acquired lock "refresh_cache-244d32a6-c532-4e7e-84dd-b747a7a05c4b" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.network.neutron [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Refreshing network info cache for port 8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Start _get_guest_xml network_info=[{"id": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "address": "fa:16:3e:d5:d1:15", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8069f888-3b", "ovs_interfaceid": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 14:59:55 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:59:55 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1756455064',display_name='tempest-ServersNegativeTestJSON-server-1756455064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1756455064',id=12,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd3bb025095b443d822303c387f0deca',ramdisk_id='',reservation_id='r-2y08kssz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-868064230',owner_user_name='tempest-ServersNegativeTestJSON-868064230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:53Z,user_data=None,user_id='8f6f7c760aea49c5a2914d1dbff90077',uuid=244d32a6-c532-4e7e-84dd-b747a7a05c4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "address": "fa:16:3e:d5:d1:15", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8069f888-3b", "ovs_interfaceid": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converting VIF {"id": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "address": "fa:16:3e:d5:d1:15", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8069f888-3b", "ovs_interfaceid": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d1:15,bridge_name='br-int',has_traffic_filtering=True,id=8069f888-3b93-4c26-9ba8-6eb3ba6b053c,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8069f888-3b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lazy-loading 'pci_devices' on Instance uuid 244d32a6-c532-4e7e-84dd-b747a7a05c4b {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23364616634313339', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23364616634313339', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:59:55 user nova-compute[73254]: INFO nova.compute.manager [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Took 6.20 seconds to build instance.
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:59:55 user nova-compute[73254]:   <uuid>244d32a6-c532-4e7e-84dd-b747a7a05c4b</uuid>
Aug 14 14:59:55 user nova-compute[73254]:   <name>instance-0000000c</name>
Aug 14 14:59:55 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:59:55 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:59:55 user nova-compute[73254]:   <metadata>
Aug 14 14:59:55 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:59:55 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:59:55 user nova-compute[73254]:       <nova:name>tempest-ServersNegativeTestJSON-server-1756455064</nova:name>
Aug 14 14:59:55 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:59:55</nova:creationTime>
Aug 14 14:59:55 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:59:55 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:59:55 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:59:55 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:59:55 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:59:55 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:59:55 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:59:55 user nova-compute[73254]:       <nova:owner>
Aug 14 14:59:55 user nova-compute[73254]:         <nova:user uuid="8f6f7c760aea49c5a2914d1dbff90077">tempest-ServersNegativeTestJSON-868064230-project-member</nova:user>
Aug 14 14:59:55 user nova-compute[73254]:         <nova:project uuid="fd3bb025095b443d822303c387f0deca">tempest-ServersNegativeTestJSON-868064230</nova:project>
Aug 14 14:59:55 user nova-compute[73254]:       </nova:owner>
Aug 14 14:59:55 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 14:59:55 user nova-compute[73254]:       <nova:ports>
Aug 14 14:59:55 user nova-compute[73254]:         <nova:port uuid="8069f888-3b93-4c26-9ba8-6eb3ba6b053c">
Aug 14 14:59:55 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 14:59:55 user nova-compute[73254]:         </nova:port>
Aug 14 14:59:55 user nova-compute[73254]:       </nova:ports>
Aug 14 14:59:55 user nova-compute[73254]:     </nova:instance>
Aug 14 14:59:55 user nova-compute[73254]:   </metadata>
Aug 14 14:59:55 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:59:55 user nova-compute[73254]:     <system>
Aug 14 14:59:55 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:59:55 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:59:55 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:59:55 user nova-compute[73254]:       <entry name="serial">244d32a6-c532-4e7e-84dd-b747a7a05c4b</entry>
Aug 14 14:59:55 user nova-compute[73254]:       <entry name="uuid">244d32a6-c532-4e7e-84dd-b747a7a05c4b</entry>
Aug 14 14:59:55 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:59:55 user nova-compute[73254]:     </system>
Aug 14 14:59:55 user nova-compute[73254]:   </sysinfo>
Aug 14 14:59:55 user nova-compute[73254]:   <os>
Aug 14 14:59:55 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:59:55 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:59:55 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:59:55 user nova-compute[73254]:   </os>
Aug 14 14:59:55 user nova-compute[73254]:   <features>
Aug 14 14:59:55 user nova-compute[73254]:     <acpi/>
Aug 14 14:59:55 user nova-compute[73254]:     <apic/>
Aug 14 14:59:55 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:59:55 user nova-compute[73254]:   </features>
Aug 14 14:59:55 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:59:55 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:59:55 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:59:55 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:59:55 user nova-compute[73254]:   </clock>
Aug 14 14:59:55 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:59:55 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:59:55 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:59:55 user nova-compute[73254]:   </cpu>
Aug 14 14:59:55 user nova-compute[73254]:   <devices>
Aug 14 14:59:55 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 14:59:55 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 14:59:55 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk"/>
Aug 14 14:59:55 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:59:55 user nova-compute[73254]:     </disk>
Aug 14 14:59:55 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:59:55 user nova-compute[73254]:       <mac address="fa:16:3e:d5:d1:15"/>
Aug 14 14:59:55 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:55 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:59:55 user nova-compute[73254]:       <target dev="tap8069f888-3b"/>
Aug 14 14:59:55 user nova-compute[73254]:     </interface>
Aug 14 14:59:55 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:59:55 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/console.log" append="off"/>
Aug 14 14:59:55 user nova-compute[73254]:     </serial>
Aug 14 14:59:55 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:59:55 user nova-compute[73254]:     <video>
Aug 14 14:59:55 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:55 user nova-compute[73254]:     </video>
Aug 14 14:59:55 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:59:55 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:59:55 user nova-compute[73254]:     </rng>
Aug 14 14:59:55 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:59:55 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:59:55 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:59:55 user nova-compute[73254]:     </memballoon>
Aug 14 14:59:55 user nova-compute[73254]:   </devices>
Aug 14 14:59:55 user nova-compute[73254]: </domain>
Aug 14 14:59:55 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1756455064',display_name='tempest-ServersNegativeTestJSON-server-1756455064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1756455064',id=12,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd3bb025095b443d822303c387f0deca',ramdisk_id='',reservation_id='r-2y08kssz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-868064230',owner_user_name='tempest-ServersNegativeTestJSON-868064230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:53Z,user_data=None,user_id='8f6f7c760aea49c5a2914d1dbff90077',uuid=244d32a6-c532-4e7e-84dd-b747a7a05c4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "address": "fa:16:3e:d5:d1:15", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8069f888-3b", "ovs_interfaceid": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converting VIF {"id": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "address": "fa:16:3e:d5:d1:15", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8069f888-3b", "ovs_interfaceid": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d1:15,bridge_name='br-int',has_traffic_filtering=True,id=8069f888-3b93-4c26-9ba8-6eb3ba6b053c,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8069f888-3b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_vif [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d1:15,bridge_name='br-int',has_traffic_filtering=True,id=8069f888-3b93-4c26-9ba8-6eb3ba6b053c,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8069f888-3b') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8069f888-3b, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8069f888-3b, col_values=(('external_ids', {'iface-id': '8069f888-3b93-4c26-9ba8-6eb3ba6b053c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:d1:15', 'vm-uuid': '244d32a6-c532-4e7e-84dd-b747a7a05c4b'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4a975942-2b2b-42f1-aa15-6c2743d77788 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.316s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:55 user nova-compute[73254]: INFO os_vif [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d1:15,bridge_name='br-int',has_traffic_filtering=True,id=8069f888-3b93-4c26-9ba8-6eb3ba6b053c,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8069f888-3b')
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjYaEIbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:59:55 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:59:55 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:59:55 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9455f2-91f1-48c5-bd23-f584397697c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:59:55 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] No VIF found with MAC fa:16:3e:d5:d1:15, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4609b651-2366-4c53-840e-536065db7ef9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91] added
Aug 14 14:59:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[393be8c2-a7b2-4fa3-bf19-6ce27b065094]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa111f8-de0e-431f-a6ae-a7328274b213]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjYaEIbo {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjYaEIbo" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3202ff7c-0a3f-4910-aa29-929df49398ed]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pjYaEIbo'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c9bcda-1abe-4bd2-a617-bd285dda96e4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f196b638-4bbc-425d-92c4-30d6931167f8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:55 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 14:59:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:55 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 14:59:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6921406d-0c22-43b0-8ab8-56136d992732]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91, portal: 172.16.0.220,3260]
Aug 14 14:59:55 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91, portal: 172.16.0.220,3260] successful.
Aug 14 14:59:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e04aa9-4091-43a3-a738-f41d8fa3d0b4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.network.neutron [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Updated VIF entry in instance network info cache for port 8069f888-3b93-4c26-9ba8-6eb3ba6b053c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG nova.network.neutron [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Updating instance_info_cache with network_info: [{"id": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "address": "fa:16:3e:d5:d1:15", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8069f888-3b", "ovs_interfaceid": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e0ef32-ddc9-4bd6-adce-cc9f05406641]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:55 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 14:59:55 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 14:59:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:55 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 14:59:55 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 14:59:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-35d65288-17f1-471c-90e1-b238eca57474 req-314335d6-6017-4435-8bf5-d5fea5d19de6 service nova] Releasing lock "refresh_cache-244d32a6-c532-4e7e-84dd-b747a7a05c4b" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ba05f2-b929-444d-a6b5-f12e63369713]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:59:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjYaEIbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23961356261306164', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961356261306164', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRjlayAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 14:59:56 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:59:56 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 14:59:56 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 14:59:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[25db15eb-c29a-48d5-8d07-ab75397d4eb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 14:59:56 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[30893bd0-4445-4c02-98e9-ee514db28baf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8] added
Aug 14 14:59:56 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f2a72d-28a3-4f8e-92b3-b8515ee3fa2c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73e30f0-e3a8-4825-a624-d4ac5fa06ca3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRjlayAF {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CRjlayAF" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b338d929-ef77-4466-9ffe-36921038dbe5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CRjlayAF'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[514efdb8-c1d0-46cc-9411-11be038908aa]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea770982-41b7-491e-8738-c7ab8479cd13]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:56 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 14:59:56 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 14:59:56 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:56 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 14:59:56 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 14:59:56 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d91a941-1f92-486d-aab7-48b9d114ee20]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8, portal: 172.16.0.220,3260]
Aug 14 14:59:56 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8, portal: 172.16.0.220,3260] successful.
Aug 14 14:59:56 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c9ebf2-7ce2-4cd0-b168-5a80a6870bb9]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[04769cd1-3a7c-444c-be10-2dda3308a90c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:57 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 14:59:57 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 14:59:57 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 14:59:57 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 14:59:57 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 14:59:57 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 14:59:57 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 14:59:57 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eacb543-5080-4442-9d58-522c53fb315c]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRjlayAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-caf36626-fa07-4b88-9cb2-4f5ccc97aeba req-534e1fe6-7e9e-428b-aaea-1a256eb2d3b0 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Received event network-vif-plugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-caf36626-fa07-4b88-9cb2-4f5ccc97aeba req-534e1fe6-7e9e-428b-aaea-1a256eb2d3b0 service nova] Acquiring lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-caf36626-fa07-4b88-9cb2-4f5ccc97aeba req-534e1fe6-7e9e-428b-aaea-1a256eb2d3b0 service nova] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-caf36626-fa07-4b88-9cb2-4f5ccc97aeba req-534e1fe6-7e9e-428b-aaea-1a256eb2d3b0 service nova] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-caf36626-fa07-4b88-9cb2-4f5ccc97aeba req-534e1fe6-7e9e-428b-aaea-1a256eb2d3b0 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] No waiting events found dispatching network-vif-plugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:59:57 user nova-compute[73254]: WARNING nova.compute.manager [req-caf36626-fa07-4b88-9cb2-4f5ccc97aeba req-534e1fe6-7e9e-428b-aaea-1a256eb2d3b0 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Received unexpected event network-vif-plugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c for instance with vm_state building and task_state spawning.
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26439656134323135', 'path': '/dev/sde'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439656134323135', 'path': '/dev/sde'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:08:1a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf6d44-2959-46a2-8439-9d1774481a00,network=Network(8191f256-1f60-412a-921b-245ea7d1e02e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf6d44-29') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2c:e2,bridge_name='br-int',has_traffic_filtering=True,id=75c5a7e8-55ff-4d62-938c-2d2cea41507c,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap75c5a7e8-55') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:21:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d4de0bf-83') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e4:5d,bridge_name='br-int',has_traffic_filtering=True,id=51b6eb3b-b190-4421-880e-846dce087fe2,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b6eb3b-b1') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3a:e9,bridge_name='br-int',has_traffic_filtering=True,id=74253df8-144f-4a08-9379-bc9175400d53,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74253df8-14') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:72:ee,bridge_name='br-int',has_traffic_filtering=True,id=3b4b50f8-90fa-4a58-8381-240f5ab9e860,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b50f8-90') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=c2b94e12-77ee-4db0-bcbd-921903a8f883,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b94e12-77') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lazy-loading 'pci_devices' on Instance uuid fd27da65-077e-4bd1-83fa-350928ca1478 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] End _get_guest_xml xml=<domain type="kvm">
Aug 14 14:59:58 user nova-compute[73254]:   <uuid>fd27da65-077e-4bd1-83fa-350928ca1478</uuid>
Aug 14 14:59:58 user nova-compute[73254]:   <name>instance-0000000a</name>
Aug 14 14:59:58 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 14:59:58 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 14:59:58 user nova-compute[73254]:   <metadata>
Aug 14 14:59:58 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 14:59:58 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 14:59:58 user nova-compute[73254]:       <nova:name>tempest-device-tagging-server-1800848975</nova:name>
Aug 14 14:59:58 user nova-compute[73254]:       <nova:creationTime>2023-08-14 14:59:53</nova:creationTime>
Aug 14 14:59:58 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 14:59:58 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 14:59:58 user nova-compute[73254]:       </nova:flavor>
Aug 14 14:59:58 user nova-compute[73254]:       <nova:owner>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:user uuid="d4b513a9757044a98bf3b1f726117e4f">tempest-TaggedBootDevicesTest-483413375-project-member</nova:user>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:project uuid="811e73c9bf0a45179efab5cdaced116b">tempest-TaggedBootDevicesTest-483413375</nova:project>
Aug 14 14:59:58 user nova-compute[73254]:       </nova:owner>
Aug 14 14:59:58 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 14:59:58 user nova-compute[73254]:       <nova:ports>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:port uuid="2eaf6d44-2959-46a2-8439-9d1774481a00">
Aug 14 14:59:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 14:59:58 user nova-compute[73254]:         </nova:port>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:port uuid="75c5a7e8-55ff-4d62-938c-2d2cea41507c">
Aug 14 14:59:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.1.1.69" ipVersion="4"/>
Aug 14 14:59:58 user nova-compute[73254]:         </nova:port>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:port uuid="1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1">
Aug 14 14:59:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.1.1.197" ipVersion="4"/>
Aug 14 14:59:58 user nova-compute[73254]:         </nova:port>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:port uuid="51b6eb3b-b190-4421-880e-846dce087fe2">
Aug 14 14:59:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Aug 14 14:59:58 user nova-compute[73254]:         </nova:port>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:port uuid="74253df8-144f-4a08-9379-bc9175400d53">
Aug 14 14:59:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.1.1.93" ipVersion="4"/>
Aug 14 14:59:58 user nova-compute[73254]:         </nova:port>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:port uuid="3b4b50f8-90fa-4a58-8381-240f5ab9e860">
Aug 14 14:59:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 14:59:58 user nova-compute[73254]:         </nova:port>
Aug 14 14:59:58 user nova-compute[73254]:         <nova:port uuid="c2b94e12-77ee-4db0-bcbd-921903a8f883">
Aug 14 14:59:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 14:59:58 user nova-compute[73254]:         </nova:port>
Aug 14 14:59:58 user nova-compute[73254]:       </nova:ports>
Aug 14 14:59:58 user nova-compute[73254]:     </nova:instance>
Aug 14 14:59:58 user nova-compute[73254]:   </metadata>
Aug 14 14:59:58 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 14:59:58 user nova-compute[73254]:     <system>
Aug 14 14:59:58 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 14:59:58 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 14:59:58 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 14:59:58 user nova-compute[73254]:       <entry name="serial">fd27da65-077e-4bd1-83fa-350928ca1478</entry>
Aug 14 14:59:58 user nova-compute[73254]:       <entry name="uuid">fd27da65-077e-4bd1-83fa-350928ca1478</entry>
Aug 14 14:59:58 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 14:59:58 user nova-compute[73254]:     </system>
Aug 14 14:59:58 user nova-compute[73254]:   </sysinfo>
Aug 14 14:59:58 user nova-compute[73254]:   <os>
Aug 14 14:59:58 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 14:59:58 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 14:59:58 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 14:59:58 user nova-compute[73254]:   </os>
Aug 14 14:59:58 user nova-compute[73254]:   <features>
Aug 14 14:59:58 user nova-compute[73254]:     <acpi/>
Aug 14 14:59:58 user nova-compute[73254]:     <apic/>
Aug 14 14:59:58 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 14:59:58 user nova-compute[73254]:   </features>
Aug 14 14:59:58 user nova-compute[73254]:   <clock offset="utc">
Aug 14 14:59:58 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 14:59:58 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 14:59:58 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 14:59:58 user nova-compute[73254]:   </clock>
Aug 14 14:59:58 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 14:59:58 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 14:59:58 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 14:59:58 user nova-compute[73254]:   </cpu>
Aug 14 14:59:58 user nova-compute[73254]:   <devices>
Aug 14 14:59:58 user nova-compute[73254]:     <disk type="file" device="cdrom">
Aug 14 14:59:58 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 14:59:58 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/fd27da65-077e-4bd1-83fa-350928ca1478/disk.config"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="hda" bus="ide"/>
Aug 14 14:59:58 user nova-compute[73254]:     </disk>
Aug 14 14:59:58 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 14:59:58 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:59:58 user nova-compute[73254]:       <source dev="/dev/sdc"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:       <serial>5e36db3d-04db-475b-8d2e-8afd9656594e</serial>
Aug 14 14:59:58 user nova-compute[73254]:     </disk>
Aug 14 14:59:58 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 14:59:58 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:59:58 user nova-compute[73254]:       <source dev="/dev/sdd"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:       <serial>23e4a28b-2368-4b63-a629-ed7ef5615f91</serial>
Aug 14 14:59:58 user nova-compute[73254]:     </disk>
Aug 14 14:59:58 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 14:59:58 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 14:59:58 user nova-compute[73254]:       <source dev="/dev/sde"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="vdc" bus="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:       <serial>5b748f02-008f-4901-8c7e-1a6257dd9ef8</serial>
Aug 14 14:59:58 user nova-compute[73254]:     </disk>
Aug 14 14:59:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:59:58 user nova-compute[73254]:       <mac address="fa:16:3e:38:08:1a"/>
Aug 14 14:59:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="tap2eaf6d44-29"/>
Aug 14 14:59:58 user nova-compute[73254]:     </interface>
Aug 14 14:59:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:59:58 user nova-compute[73254]:       <mac address="fa:16:3e:bb:2c:e2"/>
Aug 14 14:59:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="tap75c5a7e8-55"/>
Aug 14 14:59:58 user nova-compute[73254]:     </interface>
Aug 14 14:59:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:59:58 user nova-compute[73254]:       <mac address="fa:16:3e:56:21:1e"/>
Aug 14 14:59:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="tap1d4de0bf-83"/>
Aug 14 14:59:58 user nova-compute[73254]:     </interface>
Aug 14 14:59:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:59:58 user nova-compute[73254]:       <mac address="fa:16:3e:ea:e4:5d"/>
Aug 14 14:59:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="tap51b6eb3b-b1"/>
Aug 14 14:59:58 user nova-compute[73254]:     </interface>
Aug 14 14:59:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:59:58 user nova-compute[73254]:       <mac address="fa:16:3e:8b:3a:e9"/>
Aug 14 14:59:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="tap74253df8-14"/>
Aug 14 14:59:58 user nova-compute[73254]:     </interface>
Aug 14 14:59:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:59:58 user nova-compute[73254]:       <mac address="fa:16:3e:4a:72:ee"/>
Aug 14 14:59:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="tap3b4b50f8-90"/>
Aug 14 14:59:58 user nova-compute[73254]:     </interface>
Aug 14 14:59:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 14:59:58 user nova-compute[73254]:       <mac address="fa:16:3e:72:6f:77"/>
Aug 14 14:59:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 14:59:58 user nova-compute[73254]:       <target dev="tapc2b94e12-77"/>
Aug 14 14:59:58 user nova-compute[73254]:     </interface>
Aug 14 14:59:58 user nova-compute[73254]:     <serial type="pty">
Aug 14 14:59:58 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/fd27da65-077e-4bd1-83fa-350928ca1478/console.log" append="off"/>
Aug 14 14:59:58 user nova-compute[73254]:     </serial>
Aug 14 14:59:58 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 14:59:58 user nova-compute[73254]:     <video>
Aug 14 14:59:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 14:59:58 user nova-compute[73254]:     </video>
Aug 14 14:59:58 user nova-compute[73254]:     <rng model="virtio">
Aug 14 14:59:58 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 14:59:58 user nova-compute[73254]:     </rng>
Aug 14 14:59:58 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 14:59:58 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 14:59:58 user nova-compute[73254]:       <stats period="10"/>
Aug 14 14:59:58 user nova-compute[73254]:     </memballoon>
Aug 14 14:59:58 user nova-compute[73254]:   </devices>
Aug 14 14:59:58 user nova-compute[73254]: </domain>
Aug 14 14:59:58 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:08:1a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf6d44-2959-46a2-8439-9d1774481a00,network=Network(8191f256-1f60-412a-921b-245ea7d1e02e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf6d44-29') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:08:1a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf6d44-2959-46a2-8439-9d1774481a00,network=Network(8191f256-1f60-412a-921b-245ea7d1e02e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf6d44-29') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eaf6d44-29, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2eaf6d44-29, col_values=(('external_ids', {'iface-id': '2eaf6d44-2959-46a2-8439-9d1774481a00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:08:1a', 'vm-uuid': 'fd27da65-077e-4bd1-83fa-350928ca1478'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:59:58 user nova-compute[73254]: INFO os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:08:1a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf6d44-2959-46a2-8439-9d1774481a00,network=Network(8191f256-1f60-412a-921b-245ea7d1e02e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf6d44-29')
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2c:e2,bridge_name='br-int',has_traffic_filtering=True,id=75c5a7e8-55ff-4d62-938c-2d2cea41507c,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap75c5a7e8-55') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2c:e2,bridge_name='br-int',has_traffic_filtering=True,id=75c5a7e8-55ff-4d62-938c-2d2cea41507c,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap75c5a7e8-55') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75c5a7e8-55, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75c5a7e8-55, col_values=(('external_ids', {'iface-id': '75c5a7e8-55ff-4d62-938c-2d2cea41507c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:2c:e2', 'vm-uuid': 'fd27da65-077e-4bd1-83fa-350928ca1478'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: INFO os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2c:e2,bridge_name='br-int',has_traffic_filtering=True,id=75c5a7e8-55ff-4d62-938c-2d2cea41507c,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap75c5a7e8-55')
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:21:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d4de0bf-83') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:21:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d4de0bf-83') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d4de0bf-83, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d4de0bf-83, col_values=(('external_ids', {'iface-id': '1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:21:1e', 'vm-uuid': 'fd27da65-077e-4bd1-83fa-350928ca1478'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: INFO os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:21:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d4de0bf-83')
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e4:5d,bridge_name='br-int',has_traffic_filtering=True,id=51b6eb3b-b190-4421-880e-846dce087fe2,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b6eb3b-b1') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e4:5d,bridge_name='br-int',has_traffic_filtering=True,id=51b6eb3b-b190-4421-880e-846dce087fe2,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b6eb3b-b1') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51b6eb3b-b1, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51b6eb3b-b1, col_values=(('external_ids', {'iface-id': '51b6eb3b-b190-4421-880e-846dce087fe2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:e4:5d', 'vm-uuid': 'fd27da65-077e-4bd1-83fa-350928ca1478'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: INFO os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e4:5d,bridge_name='br-int',has_traffic_filtering=True,id=51b6eb3b-b190-4421-880e-846dce087fe2,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b6eb3b-b1')
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3a:e9,bridge_name='br-int',has_traffic_filtering=True,id=74253df8-144f-4a08-9379-bc9175400d53,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74253df8-14') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3a:e9,bridge_name='br-int',has_traffic_filtering=True,id=74253df8-144f-4a08-9379-bc9175400d53,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74253df8-14') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74253df8-14, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap74253df8-14, col_values=(('external_ids', {'iface-id': '74253df8-144f-4a08-9379-bc9175400d53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:3a:e9', 'vm-uuid': 'fd27da65-077e-4bd1-83fa-350928ca1478'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: INFO os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3a:e9,bridge_name='br-int',has_traffic_filtering=True,id=74253df8-144f-4a08-9379-bc9175400d53,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74253df8-14')
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:72:ee,bridge_name='br-int',has_traffic_filtering=True,id=3b4b50f8-90fa-4a58-8381-240f5ab9e860,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b50f8-90') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:72:ee,bridge_name='br-int',has_traffic_filtering=True,id=3b4b50f8-90fa-4a58-8381-240f5ab9e860,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b50f8-90') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b4b50f8-90, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b4b50f8-90, col_values=(('external_ids', {'iface-id': '3b4b50f8-90fa-4a58-8381-240f5ab9e860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:72:ee', 'vm-uuid': 'fd27da65-077e-4bd1-83fa-350928ca1478'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: INFO os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:72:ee,bridge_name='br-int',has_traffic_filtering=True,id=3b4b50f8-90fa-4a58-8381-240f5ab9e860,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b50f8-90')
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T14:59:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=c2b94e12-77ee-4db0-bcbd-921903a8f883,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b94e12-77') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=c2b94e12-77ee-4db0-bcbd-921903a8f883,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b94e12-77') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2b94e12-77, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc2b94e12-77, col_values=(('external_ids', {'iface-id': 'c2b94e12-77ee-4db0-bcbd-921903a8f883', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:6f:77', 'vm-uuid': 'fd27da65-077e-4bd1-83fa-350928ca1478'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 14:59:58 user nova-compute[73254]: INFO os_vif [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=c2b94e12-77ee-4db0-bcbd-921903a8f883,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b94e12-77')
Aug 14 14:59:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] No BDM found with device name hda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] No VIF found with MAC fa:16:3e:38:08:1a, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] No VIF found with MAC fa:16:3e:8b:3a:e9, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 14:59:58 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Using config drive
Aug 14 14:59:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:58 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025198.9748275, 244d32a6-c532-4e7e-84dd-b747a7a05c4b => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:59:58 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] VM Resumed (Lifecycle Event)
Aug 14 14:59:59 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Creating config drive at /opt/stack/data/nova/instances/fd27da65-077e-4bd1-83fa-350928ca1478/disk.config
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fd27da65-077e-4bd1-83fa-350928ca1478/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3p700_s1 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fd27da65-077e-4bd1-83fa-350928ca1478/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3p700_s1" returned: 0 in 0.057s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:59 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Instance spawned successfully.
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 14:59:59 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025198.9754744, 244d32a6-c532-4e7e-84dd-b747a7a05c4b => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 14:59:59 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] VM Started (Lifecycle Event)
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:59 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 14:59:59 user nova-compute[73254]: INFO nova.compute.manager [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-80ed670b-965a-46ce-8dbc-6dde58b97439 req-32771131-bd70-42b8-91ed-8d7008e0d5b9 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Received event network-vif-plugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-80ed670b-965a-46ce-8dbc-6dde58b97439 req-32771131-bd70-42b8-91ed-8d7008e0d5b9 service nova] Acquiring lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-80ed670b-965a-46ce-8dbc-6dde58b97439 req-32771131-bd70-42b8-91ed-8d7008e0d5b9 service nova] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-80ed670b-965a-46ce-8dbc-6dde58b97439 req-32771131-bd70-42b8-91ed-8d7008e0d5b9 service nova] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-80ed670b-965a-46ce-8dbc-6dde58b97439 req-32771131-bd70-42b8-91ed-8d7008e0d5b9 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] No waiting events found dispatching network-vif-plugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 14:59:59 user nova-compute[73254]: WARNING nova.compute.manager [req-80ed670b-965a-46ce-8dbc-6dde58b97439 req-32771131-bd70-42b8-91ed-8d7008e0d5b9 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Received unexpected event network-vif-plugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c for instance with vm_state building and task_state spawning.
Aug 14 14:59:59 user nova-compute[73254]: INFO nova.compute.manager [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Took 6.89 seconds to build instance.
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8d5a6f9-28a7-48da-8c5f-7a921ca126b9 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.993s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 14:59:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-0ddcc647-bc64-42a2-ba72-a427d7eebcbb req-2a7d0bbc-7976-4861-a62b-0207ac619fdc service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0ddcc647-bc64-42a2-ba72-a427d7eebcbb req-2a7d0bbc-7976-4861-a62b-0207ac619fdc service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0ddcc647-bc64-42a2-ba72-a427d7eebcbb req-2a7d0bbc-7976-4861-a62b-0207ac619fdc service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0ddcc647-bc64-42a2-ba72-a427d7eebcbb req-2a7d0bbc-7976-4861-a62b-0207ac619fdc service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-0ddcc647-bc64-42a2-ba72-a427d7eebcbb req-2a7d0bbc-7976-4861-a62b-0207ac619fdc service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:01 user nova-compute[73254]: WARNING nova.compute.manager [req-0ddcc647-bc64-42a2-ba72-a427d7eebcbb req-2a7d0bbc-7976-4861-a62b-0207ac619fdc service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-2eaf6d44-2959-46a2-8439-9d1774481a00 for instance with vm_state building and task_state spawning.
Aug 14 15:00:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025206.2076137, fd27da65-077e-4bd1-83fa-350928ca1478 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:00:06 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] VM Resumed (Lifecycle Event)
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-b27c1480-2837-4b9b-8e10-0ce6edb4c4d2 req-208f35fe-4b58-415d-b4a4-16250b597c5a service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b27c1480-2837-4b9b-8e10-0ce6edb4c4d2 req-208f35fe-4b58-415d-b4a4-16250b597c5a service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b27c1480-2837-4b9b-8e10-0ce6edb4c4d2 req-208f35fe-4b58-415d-b4a4-16250b597c5a service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b27c1480-2837-4b9b-8e10-0ce6edb4c4d2 req-208f35fe-4b58-415d-b4a4-16250b597c5a service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-b27c1480-2837-4b9b-8e10-0ce6edb4c4d2 req-208f35fe-4b58-415d-b4a4-16250b597c5a service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:06 user nova-compute[73254]: WARNING nova.compute.manager [req-b27c1480-2837-4b9b-8e10-0ce6edb4c4d2 req-208f35fe-4b58-415d-b4a4-16250b597c5a service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c for instance with vm_state building and task_state spawning.
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-80b276e0-5b94-494d-9899-f53e9b239139 req-4d87ee37-883a-4763-b6e0-745668bbd399 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-80b276e0-5b94-494d-9899-f53e9b239139 req-4d87ee37-883a-4763-b6e0-745668bbd399 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-80b276e0-5b94-494d-9899-f53e9b239139 req-4d87ee37-883a-4763-b6e0-745668bbd399 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-80b276e0-5b94-494d-9899-f53e9b239139 req-4d87ee37-883a-4763-b6e0-745668bbd399 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-80b276e0-5b94-494d-9899-f53e9b239139 req-4d87ee37-883a-4763-b6e0-745668bbd399 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:06 user nova-compute[73254]: WARNING nova.compute.manager [req-80b276e0-5b94-494d-9899-f53e9b239139 req-4d87ee37-883a-4763-b6e0-745668bbd399 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-74253df8-144f-4a08-9379-bc9175400d53 for instance with vm_state building and task_state spawning.
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-c326009e-f324-4065-8fa1-513db0b085c8 req-782433c1-6ccf-4561-85e7-e688542a3e83 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c326009e-f324-4065-8fa1-513db0b085c8 req-782433c1-6ccf-4561-85e7-e688542a3e83 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c326009e-f324-4065-8fa1-513db0b085c8 req-782433c1-6ccf-4561-85e7-e688542a3e83 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c326009e-f324-4065-8fa1-513db0b085c8 req-782433c1-6ccf-4561-85e7-e688542a3e83 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-c326009e-f324-4065-8fa1-513db0b085c8 req-782433c1-6ccf-4561-85e7-e688542a3e83 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:06 user nova-compute[73254]: WARNING nova.compute.manager [req-c326009e-f324-4065-8fa1-513db0b085c8 req-782433c1-6ccf-4561-85e7-e688542a3e83 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-2eaf6d44-2959-46a2-8439-9d1774481a00 for instance with vm_state building and task_state spawning.
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-6097ae67-857c-4bf7-94af-758f5c096b1c req-61a7875c-8a4c-4176-b32b-c89259524b67 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6097ae67-857c-4bf7-94af-758f5c096b1c req-61a7875c-8a4c-4176-b32b-c89259524b67 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6097ae67-857c-4bf7-94af-758f5c096b1c req-61a7875c-8a4c-4176-b32b-c89259524b67 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6097ae67-857c-4bf7-94af-758f5c096b1c req-61a7875c-8a4c-4176-b32b-c89259524b67 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-6097ae67-857c-4bf7-94af-758f5c096b1c req-61a7875c-8a4c-4176-b32b-c89259524b67 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:06 user nova-compute[73254]: WARNING nova.compute.manager [req-6097ae67-857c-4bf7-94af-758f5c096b1c req-61a7875c-8a4c-4176-b32b-c89259524b67 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-74253df8-144f-4a08-9379-bc9175400d53 for instance with vm_state building and task_state spawning.
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:06 user nova-compute[73254]: WARNING nova.compute.manager [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c for instance with vm_state building and task_state spawning.
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:06 user nova-compute[73254]: WARNING nova.compute.manager [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 for instance with vm_state building and task_state spawning.
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-changed-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Refreshing instance network info cache due to event network-changed-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] Acquiring lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] Acquired lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Refreshing network info cache for port 5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:07 user nova-compute[73254]: WARNING nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 for instance with vm_state building and task_state spawning.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-changed-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Refreshing instance network info cache due to event network-changed-d61382b4-4de4-4c87-af8d-1e23129c8d9c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Acquiring lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Acquired lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.network.neutron [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Refreshing network info cache for port d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:07 user nova-compute[73254]: WARNING nova.compute.manager [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 for instance with vm_state building and task_state spawning.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:07 user nova-compute[73254]: WARNING nova.compute.manager [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-51b6eb3b-b190-4421-880e-846dce087fe2 for instance with vm_state building and task_state spawning.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:07 user nova-compute[73254]: WARNING nova.compute.manager [req-9a75cd52-f5af-4c8c-8a39-1eb8a312aa37 req-ca807252-5cb0-4735-aa28-a3e001fabde1 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-51b6eb3b-b190-4421-880e-846dce087fe2 for instance with vm_state building and task_state spawning.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:00:07 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:00:07 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7045MB free_disk=25.638587951660156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:07 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Instance spawned successfully.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:00:07 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025206.2095819, fd27da65-077e-4bd1-83fa-350928ca1478 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:00:07 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] VM Started (Lifecycle Event)
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:00:07 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 16996b6c-6d6e-4b51-88f3-0ca024e95639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0110dafc-b336-45bd-aade-0eb9ba632a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c07824af-f4a5-4018-a1e5-40cb58643bc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 94250a67-88b2-48ac-88ad-8b298cf66692 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance da915cb7-8ab5-4c65-928f-70e94811dd4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance fe35bcec-a10d-4554-8cd7-1a9d1a72f484 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 2d7ac783-716a-4c23-9466-fa7d5eae73a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0674641b-1cd6-43ba-9970-f3cdd88a2b59 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance fd27da65-077e-4bd1-83fa-350928ca1478 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 244d32a6-c532-4e7e-84dd-b747a7a05c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:00:07 user nova-compute[73254]: INFO nova.compute.manager [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Took 13.61 seconds to spawn the instance on the hypervisor.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:00:07 user nova-compute[73254]: INFO nova.compute.manager [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Took 46.55 seconds to build instance.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e8ed61ee-daaf-49d2-954d-c1fd10bbd28b tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "fd27da65-077e-4bd1-83fa-350928ca1478" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.661s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-ab8d5ffd-a292-4e5f-b935-bfef2d2ea536 req-b52ebeeb-fdda-4dd2-9312-e613993f0cdd service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ab8d5ffd-a292-4e5f-b935-bfef2d2ea536 req-b52ebeeb-fdda-4dd2-9312-e613993f0cdd service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ab8d5ffd-a292-4e5f-b935-bfef2d2ea536 req-b52ebeeb-fdda-4dd2-9312-e613993f0cdd service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ab8d5ffd-a292-4e5f-b935-bfef2d2ea536 req-b52ebeeb-fdda-4dd2-9312-e613993f0cdd service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-ab8d5ffd-a292-4e5f-b935-bfef2d2ea536 req-b52ebeeb-fdda-4dd2-9312-e613993f0cdd service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:07 user nova-compute[73254]: WARNING nova.compute.manager [req-ab8d5ffd-a292-4e5f-b935-bfef2d2ea536 req-b52ebeeb-fdda-4dd2-9312-e613993f0cdd service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 for instance with vm_state active and task_state None.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.network.neutron [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updated VIF entry in instance network info cache for port d61382b4-4de4-4c87-af8d-1e23129c8d9c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.network.neutron [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating instance_info_cache with network_info: [{"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Releasing lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:07 user nova-compute[73254]: WARNING nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 for instance with vm_state building and task_state spawning.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:07 user nova-compute[73254]: WARNING nova.compute.manager [req-224e2ec0-1dfe-4b2f-9c35-0738fce356f0 req-5c7c0113-de58-416e-9c6c-990453de1645 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 for instance with vm_state building and task_state spawning.
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:00:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.887s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:08 user nova-compute[73254]: DEBUG nova.network.neutron [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updated VIF entry in instance network info cache for port 5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:08 user nova-compute[73254]: DEBUG nova.network.neutron [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance_info_cache with network_info: [{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24506acf-2971-458c-a2c7-ae5b21505783 req-c02f606e-6dee-451d-ab24-e01df4b8b00c service nova] Releasing lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:00:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:00:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:09 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:00:09 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance_info_cache with network_info: [{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:00:09 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:00:09 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:00:09 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:00:09 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:00:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:11 user nova-compute[73254]: INFO nova.compute.manager [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Shelving
Aug 14 15:00:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-e32c4f70-bae2-4a55-8591-fde79c9c5c5d req-9a20c824-19e1-459a-89c1-027465015caa service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-vif-unplugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e32c4f70-bae2-4a55-8591-fde79c9c5c5d req-9a20c824-19e1-459a-89c1-027465015caa service nova] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e32c4f70-bae2-4a55-8591-fde79c9c5c5d req-9a20c824-19e1-459a-89c1-027465015caa service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e32c4f70-bae2-4a55-8591-fde79c9c5c5d req-9a20c824-19e1-459a-89c1-027465015caa service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-e32c4f70-bae2-4a55-8591-fde79c9c5c5d req-9a20c824-19e1-459a-89c1-027465015caa service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] No waiting events found dispatching network-vif-unplugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:11 user nova-compute[73254]: WARNING nova.compute.manager [req-e32c4f70-bae2-4a55-8591-fde79c9c5c5d req-9a20c824-19e1-459a-89c1-027465015caa service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received unexpected event network-vif-unplugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c for instance with vm_state active and task_state shelving.
Aug 14 15:00:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:11 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Instance destroyed successfully.
Aug 14 15:00:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:11 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Beginning cold snapshot process
Aug 14 15:00:12 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:00:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk /opt/stack/data/nova/instances/snapshots/tmp0d8cah3l/4c2444bee1344be7ae10098f66e3e0e8 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk /opt/stack/data/nova/instances/snapshots/tmp0d8cah3l/4c2444bee1344be7ae10098f66e3e0e8" returned: 0 in 0.950s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Snapshot extracted, beginning image upload
Aug 14 15:00:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-6c775d9d-1508-41d3-8147-3010b1ac1fa3 req-1347e0ab-e076-432f-a933-cd6702ec4414 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6c775d9d-1508-41d3-8147-3010b1ac1fa3 req-1347e0ab-e076-432f-a933-cd6702ec4414 service nova] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6c775d9d-1508-41d3-8147-3010b1ac1fa3 req-1347e0ab-e076-432f-a933-cd6702ec4414 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6c775d9d-1508-41d3-8147-3010b1ac1fa3 req-1347e0ab-e076-432f-a933-cd6702ec4414 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-6c775d9d-1508-41d3-8147-3010b1ac1fa3 req-1347e0ab-e076-432f-a933-cd6702ec4414 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] No waiting events found dispatching network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:13 user nova-compute[73254]: WARNING nova.compute.manager [req-6c775d9d-1508-41d3-8147-3010b1ac1fa3 req-1347e0ab-e076-432f-a933-cd6702ec4414 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received unexpected event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 15:00:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Snapshot image upload complete
Aug 14 15:00:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:00:15 user nova-compute[73254]: INFO nova.compute.manager [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Shelve offloading
Aug 14 15:00:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Instance destroyed successfully.
Aug 14 15:00:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:00:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquired lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:00:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating instance_info_cache with network_info: [{"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Releasing lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:17 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Instance destroyed successfully.
Aug 14 15:00:17 user nova-compute[73254]: DEBUG nova.objects.instance [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'resources' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-996986071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-996986071',id=3,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE81NCosY+hLSxQaT3YJdECPNmBC8K0IxTMmr5YY07y2f737ryycLfCD8u3aPgJZ2NssoC5w8RqzmFE2YN7aQNTJ2cW7URXqJqd2kVemceJPz7jm7EjYN9xNLeng+fhOiw==',key_name='tempest-keypair-23196029',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-72pyg0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member',shelved_at='2023-08-14T15:00:15.922422',shelved_host='user',shelved_image_id='1f049d37-6fa4-4642-995e-602f38910e77'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:00:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01e4cd7e-3fd9-47fe-870e-31fcd457e263,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG os_vif [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd61382b4-4d, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:17 user nova-compute[73254]: INFO os_vif [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d')
Aug 14 15:00:17 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Deleting instance files /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263_del
Aug 14 15:00:17 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Deletion of /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263_del complete
Aug 14 15:00:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-7df5e2d1-9390-41a0-90e6-ce1c3c6da991 req-d5f9197c-442f-4eba-8204-97e46c2768f9 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-changed-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-7df5e2d1-9390-41a0-90e6-ce1c3c6da991 req-d5f9197c-442f-4eba-8204-97e46c2768f9 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Refreshing instance network info cache due to event network-changed-d61382b4-4de4-4c87-af8d-1e23129c8d9c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7df5e2d1-9390-41a0-90e6-ce1c3c6da991 req-d5f9197c-442f-4eba-8204-97e46c2768f9 service nova] Acquiring lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7df5e2d1-9390-41a0-90e6-ce1c3c6da991 req-d5f9197c-442f-4eba-8204-97e46c2768f9 service nova] Acquired lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-7df5e2d1-9390-41a0-90e6-ce1c3c6da991 req-d5f9197c-442f-4eba-8204-97e46c2768f9 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Refreshing network info cache for port d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73254) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 14 15:00:17 user nova-compute[73254]: INFO nova.virt.libvirt.host [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] UEFI support detected
Aug 14 15:00:17 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Deleted allocations for instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263
Aug 14 15:00:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:17 user nova-compute[73254]: DEBUG nova.objects.instance [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'numa_topology' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:18 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:00:18 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:00:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-43cf0e01-3c66-499d-bc18-6c7d584c8587 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.021s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:18 user nova-compute[73254]: DEBUG nova.network.neutron [req-7df5e2d1-9390-41a0-90e6-ce1c3c6da991 req-d5f9197c-442f-4eba-8204-97e46c2768f9 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updated VIF entry in instance network info cache for port d61382b4-4de4-4c87-af8d-1e23129c8d9c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:18 user nova-compute[73254]: DEBUG nova.network.neutron [req-7df5e2d1-9390-41a0-90e6-ce1c3c6da991 req-d5f9197c-442f-4eba-8204-97e46c2768f9 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating instance_info_cache with network_info: [{"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd61382b4-4d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7df5e2d1-9390-41a0-90e6-ce1c3c6da991 req-d5f9197c-442f-4eba-8204-97e46c2768f9 service nova] Releasing lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:00:22 user nova-compute[73254]: INFO nova.compute.claims [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Claim successful on node user
Aug 14 15:00:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-4e3dc2fc-a16e-4788-8b60-254f2f447e29 req-3ecd261b-72e9-4d15-8018-07912c10b1ca service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received event network-changed-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-4e3dc2fc-a16e-4788-8b60-254f2f447e29 req-3ecd261b-72e9-4d15-8018-07912c10b1ca service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Refreshing instance network info cache due to event network-changed-86ba53fe-cce2-4789-bba6-f5c6dc63300c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4e3dc2fc-a16e-4788-8b60-254f2f447e29 req-3ecd261b-72e9-4d15-8018-07912c10b1ca service nova] Acquiring lock "refresh_cache-c07824af-f4a5-4018-a1e5-40cb58643bc8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4e3dc2fc-a16e-4788-8b60-254f2f447e29 req-3ecd261b-72e9-4d15-8018-07912c10b1ca service nova] Acquired lock "refresh_cache-c07824af-f4a5-4018-a1e5-40cb58643bc8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:22 user nova-compute[73254]: DEBUG nova.network.neutron [req-4e3dc2fc-a16e-4788-8b60-254f2f447e29 req-3ecd261b-72e9-4d15-8018-07912c10b1ca service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Refreshing network info cache for port 86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:23 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:00:23 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:00:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.951s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:00:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:00:23 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:00:23 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:00:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG nova.policy [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55b05671f1cb4c05a7bedb3559968162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038244b91aad403897eb49752db371e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG nova.network.neutron [req-4e3dc2fc-a16e-4788-8b60-254f2f447e29 req-3ecd261b-72e9-4d15-8018-07912c10b1ca service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Updated VIF entry in instance network info cache for port 86ba53fe-cce2-4789-bba6-f5c6dc63300c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG nova.network.neutron [req-4e3dc2fc-a16e-4788-8b60-254f2f447e29 req-3ecd261b-72e9-4d15-8018-07912c10b1ca service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Updating instance_info_cache with network_info: [{"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4e3dc2fc-a16e-4788-8b60-254f2f447e29 req-3ecd261b-72e9-4d15-8018-07912c10b1ca service nova] Releasing lock "refresh_cache-c07824af-f4a5-4018-a1e5-40cb58643bc8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-b267b000-fd2d-4275-941d-b192ad8ff071 req-6330d828-7df8-4105-883f-83e3cd54c57c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received event network-changed-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-b267b000-fd2d-4275-941d-b192ad8ff071 req-6330d828-7df8-4105-883f-83e3cd54c57c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Refreshing instance network info cache due to event network-changed-83dbfd08-9b03-4c15-a4ad-52c48518c446. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b267b000-fd2d-4275-941d-b192ad8ff071 req-6330d828-7df8-4105-883f-83e3cd54c57c service nova] Acquiring lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b267b000-fd2d-4275-941d-b192ad8ff071 req-6330d828-7df8-4105-883f-83e3cd54c57c service nova] Acquired lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG nova.network.neutron [req-b267b000-fd2d-4275-941d-b192ad8ff071 req-6330d828-7df8-4105-883f-83e3cd54c57c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Refreshing network info cache for port 83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:00:24 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Creating image(s)
Aug 14 15:00:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "/opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "/opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "/opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "0b669b6d5d81b5be56f314fc1aae85ad3a737c72" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "0b669b6d5d81b5be56f314fc1aae85ad3a737c72" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72.part --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Acquiring lock "94250a67-88b2-48ac-88ad-8b298cf66692" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "94250a67-88b2-48ac-88ad-8b298cf66692" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG nova.objects.instance [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lazy-loading 'flavor' on Instance uuid 94250a67-88b2-48ac-88ad-8b298cf66692 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "94250a67-88b2-48ac-88ad-8b298cf66692" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72.part --force-share --output=json" returned: 0 in 0.265s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG nova.virt.images [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] a0220f8b-97d4-42fe-9697-e709062be4a4 was qcow2, converting to raw {{(pid=73254) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72.part /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72.converted {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Acquiring lock "94250a67-88b2-48ac-88ad-8b298cf66692" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "94250a67-88b2-48ac-88ad-8b298cf66692" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:25 user nova-compute[73254]: INFO nova.compute.manager [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Attaching volume 82be0d07-becf-4a73-9768-838115ece48e to /dev/vdb
Aug 14 15:00:25 user nova-compute[73254]: DEBUG os_brick.utils [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[722e30b2-78ff-4414-a028-0db66d98cd93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-71e7b76c-0748-41d0-9298-40a285dd4c76 req-d0cacc49-36e0-4449-9055-e42abf9cc29c service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received event network-changed-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-71e7b76c-0748-41d0-9298-40a285dd4c76 req-d0cacc49-36e0-4449-9055-e42abf9cc29c service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Refreshing instance network info cache due to event network-changed-fd587446-7efc-479b-ba55-a4f56918b88d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-71e7b76c-0748-41d0-9298-40a285dd4c76 req-d0cacc49-36e0-4449-9055-e42abf9cc29c service nova] Acquiring lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-71e7b76c-0748-41d0-9298-40a285dd4c76 req-d0cacc49-36e0-4449-9055-e42abf9cc29c service nova] Acquired lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG nova.network.neutron [req-71e7b76c-0748-41d0-9298-40a285dd4c76 req-d0cacc49-36e0-4449-9055-e42abf9cc29c service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Refreshing network info cache for port fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b46202a-dc39-4a5b-a5fa-0921a04eabaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27df580-4e96-4151-8e5f-b4f45e3f92ce]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[037d1945-28eb-41fe-9708-7eb757866992]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:00:25 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efe8f74-e9f3-4186-890e-16b24baa9987]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG os_brick.utils [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Updating existing volume attachment record: 1d3aee95-ab74-4b20-b538-ba0f7940eda0 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72.part /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72.converted" returned: 0 in 0.360s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72.converted --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG nova.network.neutron [req-b267b000-fd2d-4275-941d-b192ad8ff071 req-6330d828-7df8-4105-883f-83e3cd54c57c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Updated VIF entry in instance network info cache for port 83dbfd08-9b03-4c15-a4ad-52c48518c446. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG nova.network.neutron [req-b267b000-fd2d-4275-941d-b192ad8ff071 req-6330d828-7df8-4105-883f-83e3cd54c57c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Updating instance_info_cache with network_info: [{"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Successfully created port: 54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b267b000-fd2d-4275-941d-b192ad8ff071 req-6330d828-7df8-4105-883f-83e3cd54c57c service nova] Releasing lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "0b669b6d5d81b5be56f314fc1aae85ad3a737c72" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.279s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72 --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "0b669b6d5d81b5be56f314fc1aae85ad3a737c72" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "0b669b6d5d81b5be56f314fc1aae85ad3a737c72" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.network.neutron [req-71e7b76c-0748-41d0-9298-40a285dd4c76 req-d0cacc49-36e0-4449-9055-e42abf9cc29c service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Updated VIF entry in instance network info cache for port fd587446-7efc-479b-ba55-a4f56918b88d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.network.neutron [req-71e7b76c-0748-41d0-9298-40a285dd4c76 req-d0cacc49-36e0-4449-9055-e42abf9cc29c service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Updating instance_info_cache with network_info: [{"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72 --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72,backing_fmt=raw /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-71e7b76c-0748-41d0-9298-40a285dd4c76 req-d0cacc49-36e0-4449-9055-e42abf9cc29c service nova] Releasing lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72,backing_fmt=raw /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk 1073741824" returned: 0 in 0.058s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "0b669b6d5d81b5be56f314fc1aae85ad3a737c72" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Successfully updated port: 54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquired lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72 --force-share --output=json" returned: 0 in 0.219s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lazy-loading 'flavor' on Instance uuid c07824af-f4a5-4018-a1e5-40cb58643bc8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Cannot resize image /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.objects.instance [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'migration_context' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025211.8480344, 01e4cd7e-3fd9-47fe-870e-31fcd457e263 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:00:26 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] VM Stopped (Lifecycle Event)
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Ensure instance console log exists: /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1c7e009f-50ae-4bbc-adb4-d49db86adfef None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:00:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updating instance_info_cache with network_info: [{"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Releasing lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Instance network_info: |[{"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Start _get_guest_xml network_info=[{"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T15:00:20Z,direct_url=<?>,disk_format='qcow2',id=a0220f8b-97d4-42fe-9697-e709062be4a4,min_disk=0,min_ram=0,name='tempest-scenario-img--2087775422',owner='038244b91aad403897eb49752db371e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T15:00:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'a0220f8b-97d4-42fe-9697-e709062be4a4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:27 user nova-compute[73254]: INFO nova.compute.manager [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Attaching volume 4dc87d11-c25b-4101-a363-9d52043af237 to /dev/sdc
Aug 14 15:00:27 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:00:27 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T15:00:20Z,direct_url=<?>,disk_format='qcow2',id=a0220f8b-97d4-42fe-9697-e709062be4a4,min_disk=0,min_ram=0,name='tempest-scenario-img--2087775422',owner='038244b91aad403897eb49752db371e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T15:00:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230610477',display_name='tempest-TestMinimumBasicScenario-server-230610477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230610477',id=13,image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5ULTwch7uAvfJ98sDf6jNl80RmElLj5L4Z/IsYvkUB78J8+ETM0qoah7POpI+iRPMndWlC9GBpuQk3Hewhkl3N7ftFItYhb2+jfwzTfkCI1veITs45QF0ygrq6l6wz1Q==',key_name='tempest-TestMinimumBasicScenario-2005249306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='038244b91aad403897eb49752db371e7',ramdisk_id='',reservation_id='r-3h6820pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-270556114',owner_user_name='tempest-TestMinimumBasicScenario-270556114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:00:24Z,user_data=None,user_id='55b05671f1cb4c05a7bedb3559968162',uuid=81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converting VIF {"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.objects.instance [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'pci_devices' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG os_brick.utils [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:00:27 user nova-compute[73254]:   <uuid>81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7</uuid>
Aug 14 15:00:27 user nova-compute[73254]:   <name>instance-0000000d</name>
Aug 14 15:00:27 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:00:27 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:00:27 user nova-compute[73254]:   <metadata>
Aug 14 15:00:27 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:00:27 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:00:27 user nova-compute[73254]:       <nova:name>tempest-TestMinimumBasicScenario-server-230610477</nova:name>
Aug 14 15:00:27 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:00:27</nova:creationTime>
Aug 14 15:00:27 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:00:27 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:00:27 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:00:27 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:00:27 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:00:27 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:00:27 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:00:27 user nova-compute[73254]:       <nova:owner>
Aug 14 15:00:27 user nova-compute[73254]:         <nova:user uuid="55b05671f1cb4c05a7bedb3559968162">tempest-TestMinimumBasicScenario-270556114-project-member</nova:user>
Aug 14 15:00:27 user nova-compute[73254]:         <nova:project uuid="038244b91aad403897eb49752db371e7">tempest-TestMinimumBasicScenario-270556114</nova:project>
Aug 14 15:00:27 user nova-compute[73254]:       </nova:owner>
Aug 14 15:00:27 user nova-compute[73254]:       <nova:root type="image" uuid="a0220f8b-97d4-42fe-9697-e709062be4a4"/>
Aug 14 15:00:27 user nova-compute[73254]:       <nova:ports>
Aug 14 15:00:27 user nova-compute[73254]:         <nova:port uuid="54c73d11-8f49-4e16-ae68-750d0c2cea9b">
Aug 14 15:00:27 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 15:00:27 user nova-compute[73254]:         </nova:port>
Aug 14 15:00:27 user nova-compute[73254]:       </nova:ports>
Aug 14 15:00:27 user nova-compute[73254]:     </nova:instance>
Aug 14 15:00:27 user nova-compute[73254]:   </metadata>
Aug 14 15:00:27 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:00:27 user nova-compute[73254]:     <system>
Aug 14 15:00:27 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:00:27 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:00:27 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:00:27 user nova-compute[73254]:       <entry name="serial">81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7</entry>
Aug 14 15:00:27 user nova-compute[73254]:       <entry name="uuid">81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7</entry>
Aug 14 15:00:27 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:00:27 user nova-compute[73254]:     </system>
Aug 14 15:00:27 user nova-compute[73254]:   </sysinfo>
Aug 14 15:00:27 user nova-compute[73254]:   <os>
Aug 14 15:00:27 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:00:27 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:00:27 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:00:27 user nova-compute[73254]:   </os>
Aug 14 15:00:27 user nova-compute[73254]:   <features>
Aug 14 15:00:27 user nova-compute[73254]:     <acpi/>
Aug 14 15:00:27 user nova-compute[73254]:     <apic/>
Aug 14 15:00:27 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:00:27 user nova-compute[73254]:   </features>
Aug 14 15:00:27 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:00:27 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:00:27 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:00:27 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:00:27 user nova-compute[73254]:   </clock>
Aug 14 15:00:27 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:00:27 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:00:27 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:00:27 user nova-compute[73254]:   </cpu>
Aug 14 15:00:27 user nova-compute[73254]:   <devices>
Aug 14 15:00:27 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:00:27 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:00:27 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk"/>
Aug 14 15:00:27 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:00:27 user nova-compute[73254]:     </disk>
Aug 14 15:00:27 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:00:27 user nova-compute[73254]:       <mac address="fa:16:3e:53:33:f6"/>
Aug 14 15:00:27 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:00:27 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:00:27 user nova-compute[73254]:       <target dev="tap54c73d11-8f"/>
Aug 14 15:00:27 user nova-compute[73254]:     </interface>
Aug 14 15:00:27 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:00:27 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/console.log" append="off"/>
Aug 14 15:00:27 user nova-compute[73254]:     </serial>
Aug 14 15:00:27 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:00:27 user nova-compute[73254]:     <video>
Aug 14 15:00:27 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:00:27 user nova-compute[73254]:     </video>
Aug 14 15:00:27 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:00:27 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:00:27 user nova-compute[73254]:     </rng>
Aug 14 15:00:27 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:00:27 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:00:27 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:00:27 user nova-compute[73254]:     </memballoon>
Aug 14 15:00:27 user nova-compute[73254]:   </devices>
Aug 14 15:00:27 user nova-compute[73254]: </domain>
Aug 14 15:00:27 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230610477',display_name='tempest-TestMinimumBasicScenario-server-230610477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230610477',id=13,image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5ULTwch7uAvfJ98sDf6jNl80RmElLj5L4Z/IsYvkUB78J8+ETM0qoah7POpI+iRPMndWlC9GBpuQk3Hewhkl3N7ftFItYhb2+jfwzTfkCI1veITs45QF0ygrq6l6wz1Q==',key_name='tempest-TestMinimumBasicScenario-2005249306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='038244b91aad403897eb49752db371e7',ramdisk_id='',reservation_id='r-3h6820pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-270556114',owner_user_name='tempest-TestMinimumBasicScenario-270556114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:00:24Z,user_data=None,user_id='55b05671f1cb4c05a7bedb3559968162',uuid=81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converting VIF {"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG os_vif [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9d6227-6916-4fd1-8cfb-ddd8b6f7f21e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54c73d11-8f, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54c73d11-8f, col_values=(('external_ids', {'iface-id': '54c73d11-8f49-4e16-ae68-750d0c2cea9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:33:f6', 'vm-uuid': '81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fcdcd2-81e0-46c1-a5ff-b3e76b0ee92b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:27 user nova-compute[73254]: INFO os_vif [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f')
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea4db41-f288-4968-b29a-00a73a67541a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7798616c-c767-443b-b6c4-ef785946aef3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:00:27 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6405fb12-8059-406e-8f10-326dcc42bfd4]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG os_brick.utils [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Updating existing volume attachment record: c6f6faf3-0c66-49cf-8790-3b1c9941140b {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] No VIF found with MAC fa:16:3e:53:33:f6, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-e84d28b0-1627-4da2-b8ee-8b36f612ad03 req-aca821e1-416f-4585-af78-662ac3cc2cbf service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-changed-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-e84d28b0-1627-4da2-b8ee-8b36f612ad03 req-aca821e1-416f-4585-af78-662ac3cc2cbf service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Refreshing instance network info cache due to event network-changed-54c73d11-8f49-4e16-ae68-750d0c2cea9b. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e84d28b0-1627-4da2-b8ee-8b36f612ad03 req-aca821e1-416f-4585-af78-662ac3cc2cbf service nova] Acquiring lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e84d28b0-1627-4da2-b8ee-8b36f612ad03 req-aca821e1-416f-4585-af78-662ac3cc2cbf service nova] Acquired lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:27 user nova-compute[73254]: DEBUG nova.network.neutron [req-e84d28b0-1627-4da2-b8ee-8b36f612ad03 req-aca821e1-416f-4585-af78-662ac3cc2cbf service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Refreshing network info cache for port 54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:28 user nova-compute[73254]: DEBUG nova.network.neutron [req-e84d28b0-1627-4da2-b8ee-8b36f612ad03 req-aca821e1-416f-4585-af78-662ac3cc2cbf service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updated VIF entry in instance network info cache for port 54c73d11-8f49-4e16-ae68-750d0c2cea9b. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:28 user nova-compute[73254]: DEBUG nova.network.neutron [req-e84d28b0-1627-4da2-b8ee-8b36f612ad03 req-aca821e1-416f-4585-af78-662ac3cc2cbf service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updating instance_info_cache with network_info: [{"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e84d28b0-1627-4da2-b8ee-8b36f612ad03 req-aca821e1-416f-4585-af78-662ac3cc2cbf service nova] Releasing lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-e2982ccb-fbc2-4719-a236-7704c8225357 req-aff9f61b-a824-4801-a8a5-021ceb0001bb service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e2982ccb-fbc2-4719-a236-7704c8225357 req-aff9f61b-a824-4801-a8a5-021ceb0001bb service nova] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e2982ccb-fbc2-4719-a236-7704c8225357 req-aff9f61b-a824-4801-a8a5-021ceb0001bb service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e2982ccb-fbc2-4719-a236-7704c8225357 req-aff9f61b-a824-4801-a8a5-021ceb0001bb service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-e2982ccb-fbc2-4719-a236-7704c8225357 req-aff9f61b-a824-4801-a8a5-021ceb0001bb service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] No waiting events found dispatching network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:29 user nova-compute[73254]: WARNING nova.compute.manager [req-e2982ccb-fbc2-4719-a236-7704c8225357 req-aff9f61b-a824-4801-a8a5-021ceb0001bb service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received unexpected event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b for instance with vm_state building and task_state spawning.
Aug 14 15:00:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lazy-loading 'flavor' on Instance uuid da915cb7-8ab5-4c65-928f-70e94811dd4e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:29 user nova-compute[73254]: INFO nova.compute.manager [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Attaching volume d1ba79ed-4499-49a7-a8a4-9a4f0549339e to /dev/vdb
Aug 14 15:00:29 user nova-compute[73254]: DEBUG os_brick.utils [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7887e43-8b86-4c28-b27e-f0c91cde8b97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb45505-d612-4fb8-a601-c6c1032ce91f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[94831932-6589-4c40-bef2-84b4df1ac387]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96d02e3-987e-430d-a68a-9539d54ceec5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:00:29 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:00:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[04709173-4c88-4493-9348-61096e440915]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG os_brick.utils [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:29 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Updating existing volume attachment record: 13e20a2a-24a5-45ef-84a5-dc8d16ee6f72 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025231.1188, 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:00:31 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] VM Resumed (Lifecycle Event)
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:00:31 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Instance spawned successfully.
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:00:31 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025231.137256, 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:00:31 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] VM Started (Lifecycle Event)
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.compute.manager [req-67a59f44-ed27-461d-ac4b-9e217c93c6fd req-2581537c-7a94-4608-8808-7ec722f1dc14 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-67a59f44-ed27-461d-ac4b-9e217c93c6fd req-2581537c-7a94-4608-8808-7ec722f1dc14 service nova] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-67a59f44-ed27-461d-ac4b-9e217c93c6fd req-2581537c-7a94-4608-8808-7ec722f1dc14 service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-67a59f44-ed27-461d-ac4b-9e217c93c6fd req-2581537c-7a94-4608-8808-7ec722f1dc14 service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.compute.manager [req-67a59f44-ed27-461d-ac4b-9e217c93c6fd req-2581537c-7a94-4608-8808-7ec722f1dc14 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] No waiting events found dispatching network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:31 user nova-compute[73254]: WARNING nova.compute.manager [req-67a59f44-ed27-461d-ac4b-9e217c93c6fd req-2581537c-7a94-4608-8808-7ec722f1dc14 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received unexpected event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b for instance with vm_state building and task_state spawning.
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:00:31 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:00:31 user nova-compute[73254]: INFO nova.compute.manager [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Took 6.64 seconds to spawn the instance on the hypervisor.
Aug 14 15:00:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:00:31 user nova-compute[73254]: INFO nova.compute.manager [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Took 8.63 seconds to build instance.
Aug 14 15:00:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eddbb87d-e5b6-4360-9dee-e4f308ce6e75 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.780s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-3b1d74dd-6fb8-4b0c-b179-4bffaeebbe35 req-2ccbb5e0-12cd-4d5b-81a2-13dacb8b0373 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received event network-changed-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-3b1d74dd-6fb8-4b0c-b179-4bffaeebbe35 req-2ccbb5e0-12cd-4d5b-81a2-13dacb8b0373 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Refreshing instance network info cache due to event network-changed-76fee70f-931e-4f07-97c3-038f881fbaf3. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3b1d74dd-6fb8-4b0c-b179-4bffaeebbe35 req-2ccbb5e0-12cd-4d5b-81a2-13dacb8b0373 service nova] Acquiring lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3b1d74dd-6fb8-4b0c-b179-4bffaeebbe35 req-2ccbb5e0-12cd-4d5b-81a2-13dacb8b0373 service nova] Acquired lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-3b1d74dd-6fb8-4b0c-b179-4bffaeebbe35 req-2ccbb5e0-12cd-4d5b-81a2-13dacb8b0373 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Refreshing network info cache for port 76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-3b1d74dd-6fb8-4b0c-b179-4bffaeebbe35 req-2ccbb5e0-12cd-4d5b-81a2-13dacb8b0373 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Updated VIF entry in instance network info cache for port 76fee70f-931e-4f07-97c3-038f881fbaf3. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-3b1d74dd-6fb8-4b0c-b179-4bffaeebbe35 req-2ccbb5e0-12cd-4d5b-81a2-13dacb8b0373 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Updating instance_info_cache with network_info: [{"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3b1d74dd-6fb8-4b0c-b179-4bffaeebbe35 req-2ccbb5e0-12cd-4d5b-81a2-13dacb8b0373 service nova] Releasing lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "interface-2d7ac783-716a-4c23-9466-fa7d5eae73a8-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "interface-2d7ac783-716a-4c23-9466-fa7d5eae73a8-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:34 user nova-compute[73254]: DEBUG nova.objects.instance [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lazy-loading 'flavor' on Instance uuid 2d7ac783-716a-4c23-9466-fa7d5eae73a8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:34 user nova-compute[73254]: DEBUG nova.objects.instance [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lazy-loading 'pci_requests' on Instance uuid 2d7ac783-716a-4c23-9466-fa7d5eae73a8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:34 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:00:34 user nova-compute[73254]: DEBUG nova.policy [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd387ffd01c7847c590051e5c685cbabf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32cc73fa0a494e44b42a9271927ec303', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:00:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6211690-e5ec-4bba-be5e-9b2ea8309496 req-6c3e3d5e-4eae-4710-9a69-c813f661ee6d service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-changed-45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6211690-e5ec-4bba-be5e-9b2ea8309496 req-6c3e3d5e-4eae-4710-9a69-c813f661ee6d service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Refreshing instance network info cache due to event network-changed-45d7f56d-49d0-40e6-9d49-768c55a51b61. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6211690-e5ec-4bba-be5e-9b2ea8309496 req-6c3e3d5e-4eae-4710-9a69-c813f661ee6d service nova] Acquiring lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6211690-e5ec-4bba-be5e-9b2ea8309496 req-6c3e3d5e-4eae-4710-9a69-c813f661ee6d service nova] Acquired lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:35 user nova-compute[73254]: DEBUG nova.network.neutron [req-f6211690-e5ec-4bba-be5e-9b2ea8309496 req-6c3e3d5e-4eae-4710-9a69-c813f661ee6d service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Refreshing network info cache for port 45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:35 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Successfully created port: 6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG nova.network.neutron [req-f6211690-e5ec-4bba-be5e-9b2ea8309496 req-6c3e3d5e-4eae-4710-9a69-c813f661ee6d service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updated VIF entry in instance network info cache for port 45d7f56d-49d0-40e6-9d49-768c55a51b61. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG nova.network.neutron [req-f6211690-e5ec-4bba-be5e-9b2ea8309496 req-6c3e3d5e-4eae-4710-9a69-c813f661ee6d service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updating instance_info_cache with network_info: [{"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6211690-e5ec-4bba-be5e-9b2ea8309496 req-6c3e3d5e-4eae-4710-9a69-c813f661ee6d service nova] Releasing lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCFVSHuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:36 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:36 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:36 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba09cb-2679-4ea3-b4ef-c283721ace6c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:00:36 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[91acd9cf-6ccd-4bac-b9eb-10fe17e21ef6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e] added
Aug 14 15:00:36 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7106f0d5-4068-4c39-abbf-b299f695f31c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[83afb737-b64e-4949-9cb1-9f03611a2afc]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kCFVSHuy {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kCFVSHuy" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8654d82-c8c7-436a-a90f-fb95a64a380c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kCFVSHuy'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a150372-ed90-4174-9d78-275c046e5ad0]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e69516f-09ac-4223-8cde-23b758aee2c6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lazy-loading 'flavor' on Instance uuid fe35bcec-a10d-4554-8cd7-1a9d1a72f484 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1abb20-819e-4020-a1a3-257529b680e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e, portal: 172.16.0.220,3260]
Aug 14 15:00:36 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e, portal: 172.16.0.220,3260] successful.
Aug 14 15:00:36 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9e13c0-3884-4ce0-be83-7296eaf0b271]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[da56285d-b0b6-47d6-bda2-86ed0812522f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)
Aug 14 15:00:36 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:36 user nova-compute[73254]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)
Aug 14 15:00:36 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.133s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b22481-5664-4657-ac39-bf04b8f90e6e]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCFVSHuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:36 user nova-compute[73254]: INFO nova.compute.manager [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Attaching volume 9036d084-2f37-44aa-9fd1-e7a9ab36079d to /dev/vdb
Aug 14 15:00:36 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Successfully updated port: 6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquired lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-b557bfec-f077-436c-9dbb-ecbd2d39e04c req-4ef00eef-ad31-4e2e-a310-2729067e8c4b service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-changed-6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-b557bfec-f077-436c-9dbb-ecbd2d39e04c req-4ef00eef-ad31-4e2e-a310-2729067e8c4b service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Refreshing instance network info cache due to event network-changed-6ac2403d-b18f-4335-b2e3-bebe706ba776. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b557bfec-f077-436c-9dbb-ecbd2d39e04c req-4ef00eef-ad31-4e2e-a310-2729067e8c4b service nova] Acquiring lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.utils [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb4e482-46a7-4335-bdfe-dccf6a6b7e15]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bda36d7-f15c-4e58-9bde-0070b5b76f07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e4b36c-57e0-484d-aa1f-9a989d6fd095]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab99598-1414-45b8-9f09-c17b88a8b5be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:00:37 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4678b08f-81dd-4ea2-8227-e81b6244fc38]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.utils [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Updating existing volume attachment record: 628be642-1d5c-4cb6-ade6-5885958d5366 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaCeJdrf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:37 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23931303661343162', 'path': '/dev/sdf'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931303661343162', 'path': '/dev/sdf'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.096s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:37 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:37 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.objects.instance [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lazy-loading 'flavor' on Instance uuid 94250a67-88b2-48ac-88ad-8b298cf66692 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b375fdb-d4d7-4598-b8fc-ce70e93e3d11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:00:37 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] attach device xml: <disk type="block" device="disk">
Aug 14 15:00:37 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:00:37 user nova-compute[73254]:   <source dev="/dev/sdf"/>
Aug 14 15:00:37 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:00:37 user nova-compute[73254]:   <serial>82be0d07-becf-4a73-9768-838115ece48e</serial>
Aug 14 15:00:37 user nova-compute[73254]: </disk>
Aug 14 15:00:37 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updating instance_info_cache with network_info: [{"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "address": "fa:16:3e:9a:5e:f2", "network": {"id": "e663ce28-72a4-40a2-8d20-d5fd53e24860", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1742618993", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac2403d-b1", "ovs_interfaceid": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c766ceb-6a23-46fe-84a6-e2646a6c5227]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237] added
Aug 14 15:00:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Releasing lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b557bfec-f077-436c-9dbb-ecbd2d39e04c req-4ef00eef-ad31-4e2e-a310-2729067e8c4b service nova] Acquired lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.network.neutron [req-b557bfec-f077-436c-9dbb-ecbd2d39e04c req-4ef00eef-ad31-4e2e-a310-2729067e8c4b service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Refreshing network info cache for port 6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53604aa-ab13-4161-b01c-4746ce813e96]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-544943482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-544943482',id=8,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcdSxFKpASTpyKhbhzDsSWv3GXJrMID1+oMw/wX47BEW8KN1RfU7r4bg37xM5MdthGSSQ9JIDbWKb/2U2KILoiTbqPHrrAmuGNudKYu3nQs30o8jYIS9Hk8qUI1/vH5qg==',key_name='tempest-keypair-273322457',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32cc73fa0a494e44b42a9271927ec303',ramdisk_id='',reservation_id='r-t6n5sxna',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1515900016',owner_user_name='tempest-TaggedAttachmentsTest-1515900016-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d387ffd01c7847c590051e5c685cbabf',uuid=2d7ac783-716a-4c23-9466-fa7d5eae73a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "address": "fa:16:3e:9a:5e:f2", "network": {"id": "e663ce28-72a4-40a2-8d20-d5fd53e24860", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1742618993", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac2403d-b1", "ovs_interfaceid": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converting VIF {"id": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "address": "fa:16:3e:9a:5e:f2", "network": {"id": "e663ce28-72a4-40a2-8d20-d5fd53e24860", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1742618993", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac2403d-b1", "ovs_interfaceid": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:f2,bridge_name='br-int',has_traffic_filtering=True,id=6ac2403d-b18f-4335-b2e3-bebe706ba776,network=Network(e663ce28-72a4-40a2-8d20-d5fd53e24860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac2403d-b1') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_vif [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:f2,bridge_name='br-int',has_traffic_filtering=True,id=6ac2403d-b18f-4335-b2e3-bebe706ba776,network=Network(e663ce28-72a4-40a2-8d20-d5fd53e24860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac2403d-b1') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ac2403d-b1, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ac2403d-b1, col_values=(('external_ids', {'iface-id': '6ac2403d-b18f-4335-b2e3-bebe706ba776', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:5e:f2', 'vm-uuid': '2d7ac783-716a-4c23-9466-fa7d5eae73a8'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1015834b-5d6c-454c-81c9-ca0f9b5e2e95]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:37 user nova-compute[73254]: INFO os_vif [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:f2,bridge_name='br-int',has_traffic_filtering=True,id=6ac2403d-b18f-4335-b2e3-bebe706ba776,network=Network(e663ce28-72a4-40a2-8d20-d5fd53e24860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac2403d-b1')
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-544943482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-544943482',id=8,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcdSxFKpASTpyKhbhzDsSWv3GXJrMID1+oMw/wX47BEW8KN1RfU7r4bg37xM5MdthGSSQ9JIDbWKb/2U2KILoiTbqPHrrAmuGNudKYu3nQs30o8jYIS9Hk8qUI1/vH5qg==',key_name='tempest-keypair-273322457',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='32cc73fa0a494e44b42a9271927ec303',ramdisk_id='',reservation_id='r-t6n5sxna',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1515900016',owner_user_name='tempest-TaggedAttachmentsTest-1515900016-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d387ffd01c7847c590051e5c685cbabf',uuid=2d7ac783-716a-4c23-9466-fa7d5eae73a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "address": "fa:16:3e:9a:5e:f2", "network": {"id": "e663ce28-72a4-40a2-8d20-d5fd53e24860", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1742618993", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac2403d-b1", "ovs_interfaceid": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converting VIF {"id": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "address": "fa:16:3e:9a:5e:f2", "network": {"id": "e663ce28-72a4-40a2-8d20-d5fd53e24860", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1742618993", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac2403d-b1", "ovs_interfaceid": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:f2,bridge_name='br-int',has_traffic_filtering=True,id=6ac2403d-b18f-4335-b2e3-bebe706ba776,network=Network(e663ce28-72a4-40a2-8d20-d5fd53e24860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac2403d-b1') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaCeJdrf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] attach device xml: <interface type="ethernet">
Aug 14 15:00:37 user nova-compute[73254]:   <mac address="fa:16:3e:9a:5e:f2"/>
Aug 14 15:00:37 user nova-compute[73254]:   <model type="virtio"/>
Aug 14 15:00:37 user nova-compute[73254]:   <mtu size="1442"/>
Aug 14 15:00:37 user nova-compute[73254]:   <target dev="tap6ac2403d-b1"/>
Aug 14 15:00:37 user nova-compute[73254]: </interface>
Aug 14 15:00:37 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XaCeJdrf" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6881975d-4e70-4eda-b3da-a797c5846598]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XaCeJdrf'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cc547e-1158-4081-819e-48a2865ceac4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[359324db-d046-4c37-bcfc-bbce2c507d20]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)
Aug 14 15:00:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)
Aug 14 15:00:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1301e9db-bc32-48e5-a173-21bc7980a7b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237, portal: 172.16.0.220,3260]
Aug 14 15:00:37 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237, portal: 172.16.0.220,3260] successful.
Aug 14 15:00:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb18f15-0416-4fc0-99b3-aae8d84983f8]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe0bbe4-e359-4916-9a58-777522aae0b0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)
Aug 14 15:00:37 user nova-compute[73254]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)
Aug 14 15:00:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.421s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.041s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a907cf8-7421-405a-afba-6f1637cfef25]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:00:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaCeJdrf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] No VIF found with MAC fa:16:3e:4d:bb:ac, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.network.neutron [req-b557bfec-f077-436c-9dbb-ecbd2d39e04c req-4ef00eef-ad31-4e2e-a310-2729067e8c4b service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updated VIF entry in instance network info cache for port 6ac2403d-b18f-4335-b2e3-bebe706ba776. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.network.neutron [req-b557bfec-f077-436c-9dbb-ecbd2d39e04c req-4ef00eef-ad31-4e2e-a310-2729067e8c4b service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updating instance_info_cache with network_info: [{"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "address": "fa:16:3e:9a:5e:f2", "network": {"id": "e663ce28-72a4-40a2-8d20-d5fd53e24860", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1742618993", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac2403d-b1", "ovs_interfaceid": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b557bfec-f077-436c-9dbb-ecbd2d39e04c req-4ef00eef-ad31-4e2e-a310-2729067e8c4b service nova] Releasing lock "refresh_cache-2d7ac783-716a-4c23-9466-fa7d5eae73a8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-68d02701-3b46-4797-a848-9f0604d03113 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "94250a67-88b2-48ac-88ad-8b298cf66692" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] No BDM found with device name hda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] No VIF found with MAC fa:16:3e:01:2a:28, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:00:38 user nova-compute[73254]:   <nova:package version="0.0.0"/>
Aug 14 15:00:38 user nova-compute[73254]:   <nova:name>tempest-device-tagging-server-544943482</nova:name>
Aug 14 15:00:38 user nova-compute[73254]:   <nova:creationTime>2023-08-14 15:00:38</nova:creationTime>
Aug 14 15:00:38 user nova-compute[73254]:   <nova:flavor name="m1.tiny">
Aug 14 15:00:38 user nova-compute[73254]:     <nova:memory>512</nova:memory>
Aug 14 15:00:38 user nova-compute[73254]:     <nova:disk>1</nova:disk>
Aug 14 15:00:38 user nova-compute[73254]:     <nova:swap>0</nova:swap>
Aug 14 15:00:38 user nova-compute[73254]:     <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:00:38 user nova-compute[73254]:     <nova:vcpus>1</nova:vcpus>
Aug 14 15:00:38 user nova-compute[73254]:   </nova:flavor>
Aug 14 15:00:38 user nova-compute[73254]:   <nova:owner>
Aug 14 15:00:38 user nova-compute[73254]:     <nova:user uuid="d387ffd01c7847c590051e5c685cbabf">tempest-TaggedAttachmentsTest-1515900016-project-member</nova:user>
Aug 14 15:00:38 user nova-compute[73254]:     <nova:project uuid="32cc73fa0a494e44b42a9271927ec303">tempest-TaggedAttachmentsTest-1515900016</nova:project>
Aug 14 15:00:38 user nova-compute[73254]:   </nova:owner>
Aug 14 15:00:38 user nova-compute[73254]:   <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:00:38 user nova-compute[73254]:   <nova:ports>
Aug 14 15:00:38 user nova-compute[73254]:     <nova:port uuid="45d7f56d-49d0-40e6-9d49-768c55a51b61">
Aug 14 15:00:38 user nova-compute[73254]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 15:00:38 user nova-compute[73254]:     </nova:port>
Aug 14 15:00:38 user nova-compute[73254]:     <nova:port uuid="6ac2403d-b18f-4335-b2e3-bebe706ba776">
Aug 14 15:00:38 user nova-compute[73254]:       <nova:ip type="fixed" address="10.10.10.94" ipVersion="4"/>
Aug 14 15:00:38 user nova-compute[73254]:     </nova:port>
Aug 14 15:00:38 user nova-compute[73254]:   </nova:ports>
Aug 14 15:00:38 user nova-compute[73254]: </nova:instance>
Aug 14 15:00:38 user nova-compute[73254]:  {{(pid=73254) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fb2281a8-e216-4be7-a615-2050fe50807b tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "interface-2d7ac783-716a-4c23-9466-fa7d5eae73a8-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.159s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c95e356a-0997-4cb2-841c-d5e769a608b9 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] volume_snapshot_create: create_info: {'snapshot_id': '22bd2b09-aeea-46da-a67b-73d2949e02ce', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73254) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c95e356a-0997-4cb2-841c-d5e769a608b9 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] snap xml: <domainsnapshot>
Aug 14 15:00:38 user nova-compute[73254]:   <disks>
Aug 14 15:00:38 user nova-compute[73254]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 14 15:00:38 user nova-compute[73254]:       <source file="/dev/new_file"/>
Aug 14 15:00:38 user nova-compute[73254]:     </disk>
Aug 14 15:00:38 user nova-compute[73254]:     <disk name="vda" snapshot="no"/>
Aug 14 15:00:38 user nova-compute[73254]:   </disks>
Aug 14 15:00:38 user nova-compute[73254]: </domainsnapshot>
Aug 14 15:00:38 user nova-compute[73254]:  {{(pid=73254) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c95e356a-0997-4cb2-841c-d5e769a608b9 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lazy-loading 'system_metadata' on Instance uuid 94250a67-88b2-48ac-88ad-8b298cf66692 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-vif-plugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] No waiting events found dispatching network-vif-plugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:38 user nova-compute[73254]: WARNING nova.compute.manager [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received unexpected event network-vif-plugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 for instance with vm_state active and task_state None.
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-vif-plugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] No waiting events found dispatching network-vif-plugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:38 user nova-compute[73254]: WARNING nova.compute.manager [req-fdd9dd7b-fdfa-4f12-a820-c59f6d80e080 req-bcc91b90-7903-4405-ac1b-86b24051b17c service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received unexpected event network-vif-plugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 for instance with vm_state active and task_state None.
Aug 14 15:00:38 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c95e356a-0997-4cb2-841c-d5e769a608b9 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 15:00:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4de30470-7283-4589-a70f-adb6440f83f8 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] volume_snapshot_delete: delete_info: {'volume_id': '82be0d07-becf-4a73-9768-838115ece48e'} {{(pid=73254) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [None req-4de30470-7283-4589-a70f-adb6440f83f8 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Traceback (most recent call last):
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     if delete_info['type'] != 'qcow2':
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] KeyError: 'type'
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] 
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [None req-c95e356a-0997-4cb2-841c-d5e769a608b9 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Traceback (most recent call last):
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     rv = execute(f, *args, **kwargs)
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     six.reraise(c, e, tb)
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     raise value
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     rv = meth(*args, **kwargs)
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] 
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [None req-c95e356a-0997-4cb2-841c-d5e769a608b9 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Traceback (most recent call last):
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     self._volume_snapshot_create(context, instance, guest,
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     rv = execute(f, *args, **kwargs)
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     six.reraise(c, e, tb)
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     raise value
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     rv = meth(*args, **kwargs)
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 15:00:38 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] 
Aug 14 15:00:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.487s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] <== connect_volume: return (1583ms) {'type': 'block', 'scsi_wwn': '23935363465663339', 'path': '/dev/sdg'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935363465663339', 'path': '/dev/sdg'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lazy-loading 'flavor' on Instance uuid c07824af-f4a5-4018-a1e5-40cb58643bc8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [None req-4de30470-7283-4589-a70f-adb6440f83f8 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver 
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver 
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-1c75717d-3433-45a9-8a0f-65c94d18cb33)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver 
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver 
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver 
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:00:39 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:00:39 user nova-compute[73254]:   <source dev="/dev/sdg"/>
Aug 14 15:00:39 user nova-compute[73254]:   <target dev="sdc" bus="scsi"/>
Aug 14 15:00:39 user nova-compute[73254]:   <serial>4dc87d11-c25b-4101-a363-9d52043af237</serial>
Aug 14 15:00:39 user nova-compute[73254]:   <address type="drive" controller="0" unit="2"/>
Aug 14 15:00:39 user nova-compute[73254]: </disk>
Aug 14 15:00:39 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server [None req-4de30470-7283-4589-a70f-adb6440f83f8 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Exception during message handling: KeyError: 'type'
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server 
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver [None req-c95e356a-0997-4cb2-841c-d5e769a608b9 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 22bd2b09-aeea-46da-a67b-73d2949e02ce could not be found.
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     raise value
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver 
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver 
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 22bd2b09-aeea-46da-a67b-73d2949e02ce could not be found. (HTTP 404) (Request-ID: req-782f4a22-99d1-4a2e-b4c3-e8e7b5b79611)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver 
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver 
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 22bd2b09-aeea-46da-a67b-73d2949e02ce could not be found.
Aug 14 15:00:39 user nova-compute[73254]: ERROR nova.virt.libvirt.driver 
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server [None req-c95e356a-0997-4cb2-841c-d5e769a608b9 tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise value
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 14 15:00:39 user nova-compute[73254]: ERROR oslo_messaging.rpc.server 
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.objects.instance [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lazy-loading 'flavor' on Instance uuid 2d7ac783-716a-4c23-9466-fa7d5eae73a8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.099s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Acquiring lock "94250a67-88b2-48ac-88ad-8b298cf66692" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "94250a67-88b2-48ac-88ad-8b298cf66692" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:39 user nova-compute[73254]: INFO nova.compute.manager [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Detaching volume 82be0d07-becf-4a73-9768-838115ece48e
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:39 user nova-compute[73254]: INFO nova.compute.manager [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Attaching volume 8f524e87-99b0-4f58-b079-f82e841ff328 to /dev/vdb
Aug 14 15:00:39 user nova-compute[73254]: INFO nova.virt.block_device [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Attempting to driver detach volume 82be0d07-becf-4a73-9768-838115ece48e from mountpoint /dev/vdb
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Attempting to detach device vdb from instance 94250a67-88b2-48ac-88ad-8b298cf66692 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 15:00:39 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:00:39 user nova-compute[73254]:   <source dev="/dev/sdf"/>
Aug 14 15:00:39 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:00:39 user nova-compute[73254]:   <serial>82be0d07-becf-4a73-9768-838115ece48e</serial>
Aug 14 15:00:39 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:00:39 user nova-compute[73254]: </disk>
Aug 14 15:00:39 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:00:39 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Successfully detached device vdb from instance 94250a67-88b2-48ac-88ad-8b298cf66692 from the persistent domain config.
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94250a67-88b2-48ac-88ad-8b298cf66692 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] detach device xml: <disk type="block" device="disk">
Aug 14 15:00:39 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:00:39 user nova-compute[73254]:   <source dev="/dev/sdf"/>
Aug 14 15:00:39 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:00:39 user nova-compute[73254]:   <serial>82be0d07-becf-4a73-9768-838115ece48e</serial>
Aug 14 15:00:39 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:00:39 user nova-compute[73254]: </disk>
Aug 14 15:00:39 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] No BDM found with device name sda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] No VIF found with MAC fa:16:3e:a1:76:2b, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG os_brick.utils [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e7318e-abe7-4c05-a9f6-ea5711ca12e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.036s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb9b08d-5d7a-4f88-b790-08509ff21bfe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4781e3ee-a187-4cce-8a08-eaf7f51f6d00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0180b0e7-35a3-442b-a6bb-9e85734ba0ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1724f830-77e9-44f3-99b0-fe30d43f5f81 tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.754s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:00:39 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:00:39 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4e6a92-9ebd-4155-8040-a23f85a3d2e8]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG os_brick.utils [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:39 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updating existing volume attachment record: 925c51c2-c124-4bb9-9e4d-02c41f82e48b {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025240.0475745, 94250a67-88b2-48ac-88ad-8b298cf66692 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94250a67-88b2-48ac-88ad-8b298cf66692 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:00:40 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Successfully detached device vdb from instance 94250a67-88b2-48ac-88ad-8b298cf66692 from the live domain config.
Aug 14 15:00:40 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kCFVSHuy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:40 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24dccd7-0886-4e2c-a399-02ca91ba9452]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[10895665-756d-45d0-9659-504a002aa05b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:40 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:40 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:40 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:40 user nova-compute[73254]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)
Aug 14 15:00:40 user nova-compute[73254]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)
Aug 14 15:00:40 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:40 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:40 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:40 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:40 user nova-compute[73254]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e (non-flash)
Aug 14 15:00:40 user nova-compute[73254]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)
Aug 14 15:00:40 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64862a950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e'): ({'sdf'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Removing single pathed devices sdf {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a1be28-42b8-4093-bba4-849adc57742c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[be86e0bc-fc3e-4862-aeda-14998562d597]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Flushing IO for device /dev/sdf {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42fd151-38b8-4900-86d2-a2f1e39d3b15]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e182f11-986d-4ab5-9d1e-f220f0ab0238]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] SCSI volumes sdf have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32c7bc6-f404-408e-8438-aa71b3979347]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c600088-0034-4b48-b6ee-bbc18ab3d0f5]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e, portal: 172.16.0.220,3260]
Aug 14 15:00:40 user nova-compute[73254]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e, portal: 172.16.0.220,3260] successful.
Aug 14 15:00:40 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c0b703-3241-49e6-a3a6-dc32b4373ddb]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] <== disconnect_volume: return (315ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGznaEyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:40 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:40 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:40 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb9f259-bad0-48c9-aedb-d4d64135fdac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:00:40 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[87581f17-492c-4c2b-ade5-260df88aeb6e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e] added
Aug 14 15:00:40 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a3839-9a2b-46b3-9d11-41d67240d96b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8197044-ec9e-4494-ae7d-f6e3c9a30b0a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGznaEyT {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JGznaEyT" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b9ceb6-8be3-4b32-994a-dbfcd78ed15b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JGznaEyT'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08a5d88-46c5-4416-bbd1-182b347e003c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6d1264-752c-4683-b072-2749580c550d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5972b9b5-cdbf-4c82-9f60-fc7556554cb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e, portal: 172.16.0.220,3260]
Aug 14 15:00:41 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e, portal: 172.16.0.220,3260] successful.
Aug 14 15:00:41 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[524a678a-1da3-42df-a6d4-4ae6b5a5e374]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b85bfd2-0aa8-45ac-8557-758b81b0bea8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e (non-flash)
Aug 14 15:00:41 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)
Aug 14 15:00:41 user nova-compute[73254]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e (non-flash)
Aug 14 15:00:41 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac34b1d1-4cf0-416d-9ea8-69658cc71b14]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGznaEyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.volume.cinder [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Update attachment failed for attachment 925c51c2-c124-4bb9-9e4d-02c41f82e48b. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 14 15:00:41 user nova-compute[73254]: Collecting current configuration:
Aug 14 15:00:41 user nova-compute[73254]: FATAL: Received the following error:
Aug 14 15:00:41 user nova-compute[73254]:         groups(): Target 'iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e' is not available
Aug 14 15:00:41 user nova-compute[73254]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 -driver iscsi -attributes MaxRecvDataSegmentLength=1048576 -noprompt...).). (HTTP 500) (Request-ID: req-cb89bff4-bc62-43df-9498-2b8e331ceda5) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error: 
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Failed to attach 8f524e87-99b0-4f58-b079-f82e841ff328 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 14 15:00:41 user nova-compute[73254]: Collecting current configuration:
Aug 14 15:00:41 user nova-compute[73254]: FATAL: Received the following error:
Aug 14 15:00:41 user nova-compute[73254]:         groups(): Target 'iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e' is not available
Aug 14 15:00:41 user nova-compute[73254]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 -driver iscsi -attributes MaxRecvDataSegmentLength=1048576 -noprompt...).). (HTTP 500) (Request-ID: req-cb89bff4-bc62-43df-9498-2b8e331ceda5)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Traceback (most recent call last):
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     ret_val = method(obj, context, *args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     self._do_attach(context, instance, volume, volume_api,
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     self._volume_attach(context, volume, connector, instance,
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     connection_info = volume_api.attachment_update(
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     res = method(self, ctx, *args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     with excutils.save_and_reraise_exception():
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     self.force_reraise()
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     raise self.value
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     return method.func(obj, *args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     resp = self._update('/attachments/%s' % id, body)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     return self.request(url, method, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]     raise exceptions.from_response(resp, body)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Collecting current configuration:
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] 
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] FATAL: Received the following error:
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] 
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8]         groups(): Target 'iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e' is not available
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] 
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 -driver iscsi -attributes MaxRecvDataSegmentLength=1048576 -noprompt...).). (HTTP 500) (Request-ID: req-cb89bff4-bc62-43df-9498-2b8e331ceda5)
Aug 14 15:00:41 user nova-compute[73254]: ERROR nova.compute.manager [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] 
Aug 14 15:00:41 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lazy-loading 'flavor' on Instance uuid 94250a67-88b2-48ac-88ad-8b298cf66692 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c25b079e-cae3-4a6a-8d00-f7f2b8e4c4ac tempest-VolumesAssistedSnapshotsTest-2041818877 tempest-VolumesAssistedSnapshotsTest-2041818877-project-admin] Lock "94250a67-88b2-48ac-88ad-8b298cf66692" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.438s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 2.411s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server [None req-19e8d865-b3ed-49e1-be38-01038f32cf93 tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 14 15:00:41 user nova-compute[73254]: Collecting current configuration:
Aug 14 15:00:41 user nova-compute[73254]: FATAL: Received the following error:
Aug 14 15:00:41 user nova-compute[73254]:         groups(): Target 'iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e' is not available
Aug 14 15:00:41 user nova-compute[73254]: :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 -driver iscsi -attributes MaxRecvDataSegmentLength=1048576 -noprompt...).). (HTTP 500) (Request-ID: req-cb89bff4-bc62-43df-9498-2b8e331ceda5)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to create target iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 because of JDSS internal system error JDSS internal system error 1:Scstadmin Error:
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server Collecting current configuration:
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server 
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server FATAL: Received the following error:
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server 
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server         groups(): Target 'iqn.2010-10.org.openstack:82be0d07-becf-4a73-9768-838115ece48e' is not available
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server 
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server :/var/nasexe/SCST/scstadmin -set_tgt_attr iqn.2010-10.org.openstack:8f524e87-99b0-4f58-b079-f82e841ff328 -driver iscsi -attributes MaxRecvDataSegmentLength=1048576 -noprompt...).). (HTTP 500) (Request-ID: req-cb89bff4-bc62-43df-9498-2b8e331ceda5)
Aug 14 15:00:41 user nova-compute[73254]: ERROR oslo_messaging.rpc.server 
Aug 14 15:00:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26131333462656138', 'path': '/dev/sdf'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131333462656138', 'path': '/dev/sdf'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lazy-loading 'flavor' on Instance uuid da915cb7-8ab5-4c65-928f-70e94811dd4e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:00:42 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:00:42 user nova-compute[73254]:   <source dev="/dev/sdf"/>
Aug 14 15:00:42 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:00:42 user nova-compute[73254]:   <serial>d1ba79ed-4499-49a7-a8a4-9a4f0549339e</serial>
Aug 14 15:00:42 user nova-compute[73254]: </disk>
Aug 14 15:00:42 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:42 user nova-compute[73254]: INFO nova.compute.manager [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Detaching volume 4dc87d11-c25b-4101-a363-9d52043af237
Aug 14 15:00:42 user nova-compute[73254]: INFO nova.virt.block_device [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Attempting to driver detach volume 4dc87d11-c25b-4101-a363-9d52043af237 from mountpoint /dev/sdc
Aug 14 15:00:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Attempting to detach device sdc from instance c07824af-f4a5-4018-a1e5-40cb58643bc8 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:00:42 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:00:42 user nova-compute[73254]:   <source dev="/dev/sdg"/>
Aug 14 15:00:42 user nova-compute[73254]:   <target dev="sdc" bus="scsi"/>
Aug 14 15:00:42 user nova-compute[73254]:   <serial>4dc87d11-c25b-4101-a363-9d52043af237</serial>
Aug 14 15:00:42 user nova-compute[73254]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 15:00:42 user nova-compute[73254]: </disk>
Aug 14 15:00:42 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:00:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Successfully detached device sdc from instance c07824af-f4a5-4018-a1e5-40cb58643bc8 from the persistent domain config.
Aug 14 15:00:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c07824af-f4a5-4018-a1e5-40cb58643bc8 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:00:42 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:00:42 user nova-compute[73254]:   <source dev="/dev/sdg"/>
Aug 14 15:00:42 user nova-compute[73254]:   <target dev="sdc" bus="scsi"/>
Aug 14 15:00:42 user nova-compute[73254]:   <serial>4dc87d11-c25b-4101-a363-9d52043af237</serial>
Aug 14 15:00:42 user nova-compute[73254]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 14 15:00:42 user nova-compute[73254]: </disk>
Aug 14 15:00:42 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] No VIF found with MAC fa:16:3e:c2:81:06, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:00:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4bc212cc-bb8d-41b3-bb5a-e6005a36021d tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.245s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025243.0023198, c07824af-f4a5-4018-a1e5-40cb58643bc8 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c07824af-f4a5-4018-a1e5-40cb58643bc8 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:00:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Successfully detached device sdc from instance c07824af-f4a5-4018-a1e5-40cb58643bc8 from the live domain config.
Aug 14 15:00:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XaCeJdrf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:43 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad69373-c028-4e64-bb58-3dc28f0f5d55]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8288434a-8125-44e3-ab9a-8fdbc0e1770d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:43 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:43 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:43 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:43 user nova-compute[73254]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)
Aug 14 15:00:43 user nova-compute[73254]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e (non-flash)
Aug 14 15:00:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:43 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:43 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:43 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:43 user nova-compute[73254]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 (non-flash)
Aug 14 15:00:43 user nova-compute[73254]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e (non-flash)
Aug 14 15:00:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6684eff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237'): ({'sdg'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Removing single pathed devices sdg {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88b9098-f3af-464b-80ae-77b0ebb7c0ad]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbccec4-e841-4453-8576-1a6014f3e12f]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Flushing IO for device /dev/sdg {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.204s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[68aab857-327a-42c6-b2c4-31e686cde585]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.378s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c36cc7d-aae2-49f9-9308-5e74896b8a02]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] SCSI volumes sdg have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[39915f69-b55e-4084-ad0f-48150b4a606f]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e87ac0-44b8-4fc5-b94d-af93104a1a4d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237, portal: 172.16.0.220,3260]
Aug 14 15:00:43 user nova-compute[73254]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237, portal: 172.16.0.220,3260] successful.
Aug 14 15:00:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c78a4e4-bed7-4e6d-be40-072aaaeda6bc]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.832s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] <== disconnect_volume: return (834ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:00:44 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lazy-loading 'flavor' on Instance uuid c07824af-f4a5-4018-a1e5-40cb58643bc8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:44 user nova-compute[73254]: INFO nova.compute.manager [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Detaching volume d1ba79ed-4499-49a7-a8a4-9a4f0549339e
Aug 14 15:00:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f61c487d-099d-4c50-bdca-73f658163e7c tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.519s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-bb520302-f7e4-4c9a-af11-b776f7eedceb req-3ae9a22c-a8bb-4d82-9dd2-97502e2ada22 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-changed-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-bb520302-f7e4-4c9a-af11-b776f7eedceb req-3ae9a22c-a8bb-4d82-9dd2-97502e2ada22 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Refreshing instance network info cache due to event network-changed-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:00:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bb520302-f7e4-4c9a-af11-b776f7eedceb req-3ae9a22c-a8bb-4d82-9dd2-97502e2ada22 service nova] Acquiring lock "refresh_cache-0674641b-1cd6-43ba-9970-f3cdd88a2b59" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:00:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bb520302-f7e4-4c9a-af11-b776f7eedceb req-3ae9a22c-a8bb-4d82-9dd2-97502e2ada22 service nova] Acquired lock "refresh_cache-0674641b-1cd6-43ba-9970-f3cdd88a2b59" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:00:44 user nova-compute[73254]: DEBUG nova.network.neutron [req-bb520302-f7e4-4c9a-af11-b776f7eedceb req-3ae9a22c-a8bb-4d82-9dd2-97502e2ada22 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Refreshing network info cache for port ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:00:44 user nova-compute[73254]: INFO nova.virt.block_device [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Attempting to driver detach volume d1ba79ed-4499-49a7-a8a4-9a4f0549339e from mountpoint /dev/vdb
Aug 14 15:00:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Attempting to detach device vdb from instance da915cb7-8ab5-4c65-928f-70e94811dd4e from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:00:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:00:44 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:00:44 user nova-compute[73254]:   <source dev="/dev/sdf"/>
Aug 14 15:00:44 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:00:44 user nova-compute[73254]:   <serial>d1ba79ed-4499-49a7-a8a4-9a4f0549339e</serial>
Aug 14 15:00:44 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:00:44 user nova-compute[73254]: </disk>
Aug 14 15:00:44 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:00:44 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Successfully detached device vdb from instance da915cb7-8ab5-4c65-928f-70e94811dd4e from the persistent domain config.
Aug 14 15:00:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da915cb7-8ab5-4c65-928f-70e94811dd4e from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:00:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:00:44 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:00:44 user nova-compute[73254]:   <source dev="/dev/sdf"/>
Aug 14 15:00:44 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:00:44 user nova-compute[73254]:   <serial>d1ba79ed-4499-49a7-a8a4-9a4f0549339e</serial>
Aug 14 15:00:44 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:00:44 user nova-compute[73254]: </disk>
Aug 14 15:00:44 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.volume.cinder [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Update attachment failed for attachment 628be642-1d5c-4cb6-ade6-5885958d5366. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 was not found.).). (HTTP 500) (Request-ID: req-27953b3e-fcb9-4641-bf4e-5ba8b9d6eff2) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 was not found.).). (HTTP 500) (Request-ID: req-27953b3e-fcb9-4641-bf4e-5ba8b9d6eff2)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Failed to attach 9036d084-2f37-44aa-9fd1-e7a9ab36079d at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 was not found.).). (HTTP 500) (Request-ID: req-27953b3e-fcb9-4641-bf4e-5ba8b9d6eff2)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Traceback (most recent call last):
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     ret_val = method(obj, context, *args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     self._do_attach(context, instance, volume, volume_api,
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     self._volume_attach(context, volume, connector, instance,
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     connection_info = volume_api.attachment_update(
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     res = method(self, ctx, *args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     with excutils.save_and_reraise_exception():
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     self.force_reraise()
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     raise self.value
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     return method.func(obj, *args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     resp = self._update('/attachments/%s' % id, body)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     return self.request(url, method, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484]     raise exceptions.from_response(resp, body)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 was not found.).). (HTTP 500) (Request-ID: req-27953b3e-fcb9-4641-bf4e-5ba8b9d6eff2)
Aug 14 15:00:45 user nova-compute[73254]: ERROR nova.compute.manager [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] 
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.604s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server [None req-d1b14062-3e2b-427d-9afe-47fc7b329360 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 was not found.).). (HTTP 500) (Request-ID: req-27953b3e-fcb9-4641-bf4e-5ba8b9d6eff2)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9036d084-2f37-44aa-9fd1-e7a9ab36079d/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4dc87d11-c25b-4101-a363-9d52043af237 was not found.).). (HTTP 500) (Request-ID: req-27953b3e-fcb9-4641-bf4e-5ba8b9d6eff2)
Aug 14 15:00:45 user nova-compute[73254]: ERROR oslo_messaging.rpc.server 
Aug 14 15:00:45 user nova-compute[73254]: DEBUG nova.network.neutron [req-bb520302-f7e4-4c9a-af11-b776f7eedceb req-3ae9a22c-a8bb-4d82-9dd2-97502e2ada22 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Updated VIF entry in instance network info cache for port ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG nova.network.neutron [req-bb520302-f7e4-4c9a-af11-b776f7eedceb req-3ae9a22c-a8bb-4d82-9dd2-97502e2ada22 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Updating instance_info_cache with network_info: [{"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025245.4421396, da915cb7-8ab5-4c65-928f-70e94811dd4e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bb520302-f7e4-4c9a-af11-b776f7eedceb req-3ae9a22c-a8bb-4d82-9dd2-97502e2ada22 service nova] Releasing lock "refresh_cache-0674641b-1cd6-43ba-9970-f3cdd88a2b59" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da915cb7-8ab5-4c65-928f-70e94811dd4e {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:00:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Successfully detached device vdb from instance da915cb7-8ab5-4c65-928f-70e94811dd4e from the live domain config.
Aug 14 15:00:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JGznaEyT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:45 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8781ed0e-9a7b-486c-aa39-4a94e191fad9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eb21b7-544c-4850-9c3b-5d9b86f00ba6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:45 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:45 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:45 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:45 user nova-compute[73254]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e (non-flash)
Aug 14 15:00:45 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:45 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:45 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:45 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:45 user nova-compute[73254]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e (non-flash)
Aug 14 15:00:45 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd668550af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e'): ({'sdf'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Removing single pathed devices sdf {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca01ba80-1b86-4a8d-9faa-f9c7494220e3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57e0e51-3729-40f0-8468-ed4b32bf495a]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Flushing IO for device /dev/sdf {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[438fc858-962c-49e1-ad86-fc21639b743c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c64f49d-74eb-4868-94e8-04fe6e0b6be2]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] SCSI volumes sdf have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b82516a-38af-4a05-98f3-5c77c28978ba]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[78101739-ed12-455f-a612-4379593d78ad]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e, portal: 172.16.0.220,3260]
Aug 14 15:00:45 user nova-compute[73254]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e, portal: 172.16.0.220,3260] successful.
Aug 14 15:00:45 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ba79ed-4499-49a7-a8a4-9a4f0549339e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea591446-a565-4aca-ab10-51b504e98e08]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] <== disconnect_volume: return (340ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:00:45 user nova-compute[73254]: INFO nova.compute.manager [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Rebuilding instance
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0674641b-1cd6-43ba-9970-f3cdd88a2b59 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:46 user nova-compute[73254]: INFO nova.compute.manager [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Terminating instance
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lazy-loading 'pci_requests' on Instance uuid 0674641b-1cd6-43ba-9970-f3cdd88a2b59 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lazy-loading 'pci_devices' on Instance uuid 0674641b-1cd6-43ba-9970-f3cdd88a2b59 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lazy-loading 'resources' on Instance uuid 0674641b-1cd6-43ba-9970-f3cdd88a2b59 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lazy-loading 'migration_context' on Instance uuid 0674641b-1cd6-43ba-9970-f3cdd88a2b59 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73254) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lazy-loading 'flavor' on Instance uuid da915cb7-8ab5-4c65-928f-70e94811dd4e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-90aa75cf-7709-452a-a8a8-a339bbb043a1 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.963s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-91c934d2-43db-4194-aed2-76920e043aa8 req-67d66697-d8c3-416a-9559-1c50c98f8509 service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received event network-vif-unplugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-91c934d2-43db-4194-aed2-76920e043aa8 req-67d66697-d8c3-416a-9559-1c50c98f8509 service nova] Acquiring lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-91c934d2-43db-4194-aed2-76920e043aa8 req-67d66697-d8c3-416a-9559-1c50c98f8509 service nova] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-91c934d2-43db-4194-aed2-76920e043aa8 req-67d66697-d8c3-416a-9559-1c50c98f8509 service nova] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-91c934d2-43db-4194-aed2-76920e043aa8 req-67d66697-d8c3-416a-9559-1c50c98f8509 service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] No waiting events found dispatching network-vif-unplugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-91c934d2-43db-4194-aed2-76920e043aa8 req-67d66697-d8c3-416a-9559-1c50c98f8509 service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received event network-vif-unplugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Instance destroyed successfully.
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lazy-loading 'resources' on Instance uuid c07824af-f4a5-4018-a1e5-40cb58643bc8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:58:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1417561268',display_name='tempest-AttachSCSIVolumeTestJSON-server-1417561268',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1417561268',id=4,image_ref='017a02e5-5386-4c50-98a2-f7c1a3f7c623',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBNobus2LDKtN1WUUenLVHGIlQkI+fLzYf1FHb25Wl2UcBEvlhP4QiNinRvI6ycf/6p5+KhIeV/Yati8BAwStYALEPZw1zFGD4+T1A/HpsZSdkYf/Lzuu7IP23D0196LQ==',key_name='tempest-keypair-1027271895',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0a37e80fa39b474fbfd3c91291de9b53',ramdisk_id='',reservation_id='r-qcydti4z',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='017a02e5-5386-4c50-98a2-f7c1a3f7c623',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1168386333',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1168386333-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba3d92631f1c4b6cbd737817c7b0778b',uuid=c07824af-f4a5-4018-a1e5-40cb58643bc8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Converting VIF {"id": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "address": "fa:16:3e:a1:76:2b", "network": {"id": "187726ca-cf7c-40d7-ad82-54532816b6a9", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1602641008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0a37e80fa39b474fbfd3c91291de9b53", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap86ba53fe-cc", "ovs_interfaceid": "86ba53fe-cce2-4789-bba6-f5c6dc63300c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:76:2b,bridge_name='br-int',has_traffic_filtering=True,id=86ba53fe-cce2-4789-bba6-f5c6dc63300c,network=Network(187726ca-cf7c-40d7-ad82-54532816b6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ba53fe-cc') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_vif [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:76:2b,bridge_name='br-int',has_traffic_filtering=True,id=86ba53fe-cce2-4789-bba6-f5c6dc63300c,network=Network(187726ca-cf7c-40d7-ad82-54532816b6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ba53fe-cc') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap86ba53fe-cc, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-14fbbbc3-1b27-4f86-82f8-b2afc8fe9040 req-35819f2d-2503-4fe7-bafc-f522d5913321 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-unplugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-14fbbbc3-1b27-4f86-82f8-b2afc8fe9040 req-35819f2d-2503-4fe7-bafc-f522d5913321 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-14fbbbc3-1b27-4f86-82f8-b2afc8fe9040 req-35819f2d-2503-4fe7-bafc-f522d5913321 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-14fbbbc3-1b27-4f86-82f8-b2afc8fe9040 req-35819f2d-2503-4fe7-bafc-f522d5913321 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-14fbbbc3-1b27-4f86-82f8-b2afc8fe9040 req-35819f2d-2503-4fe7-bafc-f522d5913321 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No waiting events found dispatching network-vif-unplugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:47 user nova-compute[73254]: WARNING nova.compute.manager [req-14fbbbc3-1b27-4f86-82f8-b2afc8fe9040 req-35819f2d-2503-4fe7-bafc-f522d5913321 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-unplugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state active and task_state rebuilding.
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:47 user nova-compute[73254]: INFO os_vif [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:76:2b,bridge_name='br-int',has_traffic_filtering=True,id=86ba53fe-cce2-4789-bba6-f5c6dc63300c,network=Network(187726ca-cf7c-40d7-ad82-54532816b6a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap86ba53fe-cc')
Aug 14 15:00:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Deleting instance files /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8_del
Aug 14 15:00:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Deletion of /opt/stack/data/nova/instances/c07824af-f4a5-4018-a1e5-40cb58643bc8_del complete
Aug 14 15:00:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Instance destroyed successfully.
Aug 14 15:00:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Instance destroyed successfully.
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-296607428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1973214659',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFl33XV+x9ts4rv7WJNVvYshjSa8TNqiIrMQzBrp0O6ibe77tIbQntCMYwdBaWlciKrpx8xErIU9j4DjFDlicSBbUrowd40KRU/vV0pPoHS0beUaHWL5ciQBFkq3LACXTg==',key_name='tempest-keypair-1229858273',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:59:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b96039e862a54a568460bdc32c225857',ramdisk_id='',reservation_id='r-ta92if1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-446563179',owner_user_name='tempest-ServerActionsV293TestJSON-446563179-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:00:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39db94ce446a44e6941ad7c0b7eab92d',uuid=0674641b-1cd6-43ba-9970-f3cdd88a2b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converting VIF {"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_vif [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac8d1a73-4e, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:47 user nova-compute[73254]: INFO os_vif [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e')
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLqsucOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:47 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[74713e02-eb47-412a-89bb-5918ea053d1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:47 user nova-compute[73254]: INFO nova.compute.manager [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Took 1.40 seconds to destroy the instance on the hypervisor.
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[538a5577-4bbe-4ff4-8a94-b34c04628e7c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:47 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:47 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:47 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:47 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:00:47 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:47 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:47 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:47 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6684ecc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fab6cd-0186-4259-9743-f0e89ffd505f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[00623cfd-8faa-4a22-b517-578d7fe23aad]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[14303d6f-9f15-4c06-b216-0396558138b3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fbc50b-292f-4bd6-a59b-9c1740db34dc]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23835613132623436', '/dev/disk/by-id/scsi-1SCST_BIO23abbab3-85a12b469b975d1e', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_23abbab3') {{(pid=84090) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ad5184-5bec-41ad-9e36-45c9f9205214]: (4, None) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5f4f7b-6ce3-42a8-9285-857f691f2d83]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde13af9-6fc7-47a8-8214-a4bc261f89c2]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260]
Aug 14 15:00:47 user nova-compute[73254]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260] successful.
Aug 14 15:00:47 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[397b83f9-b351-4b1d-8539-efea8cfe4436]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] <== disconnect_volume: return (402ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:00:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Deleting instance files /opt/stack/data/nova/instances/0674641b-1cd6-43ba-9970-f3cdd88a2b59_del
Aug 14 15:00:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Deletion of /opt/stack/data/nova/instances/0674641b-1cd6-43ba-9970-f3cdd88a2b59_del complete
Aug 14 15:00:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:48 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 0674641b-1cd6-43ba-9970-f3cdd88a2b59 could not be found.
Aug 14 15:00:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLqsucOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:00:48 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 15:00:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c293eec-d455-4cf4-bf21-2b5fae4fe499]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0a33f2-4e63-4a2c-909f-96834b42db16]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:48 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:48 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:48 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:00:48 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:00:48 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:00:48 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6684ecb80>, {}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Disconnecting from: [] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.060s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] <== disconnect_volume: return (61ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:00:48 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Took 1.11 seconds to deallocate network for instance.
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-431f28bb-c6d3-414b-a3e7-d7830bff7fd5 req-ecfa84a4-51ab-4793-aeaa-49960620c11a service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received event network-vif-plugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-431f28bb-c6d3-414b-a3e7-d7830bff7fd5 req-ecfa84a4-51ab-4793-aeaa-49960620c11a service nova] Acquiring lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-431f28bb-c6d3-414b-a3e7-d7830bff7fd5 req-ecfa84a4-51ab-4793-aeaa-49960620c11a service nova] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-431f28bb-c6d3-414b-a3e7-d7830bff7fd5 req-ecfa84a4-51ab-4793-aeaa-49960620c11a service nova] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-431f28bb-c6d3-414b-a3e7-d7830bff7fd5 req-ecfa84a4-51ab-4793-aeaa-49960620c11a service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] No waiting events found dispatching network-vif-plugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:00:48 user nova-compute[73254]: WARNING nova.compute.manager [req-431f28bb-c6d3-414b-a3e7-d7830bff7fd5 req-ecfa84a4-51ab-4793-aeaa-49960620c11a service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received unexpected event network-vif-plugged-86ba53fe-cce2-4789-bba6-f5c6dc63300c for instance with vm_state deleted and task_state None.
Aug 14 15:00:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-431f28bb-c6d3-414b-a3e7-d7830bff7fd5 req-ecfa84a4-51ab-4793-aeaa-49960620c11a service nova] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Received event network-vif-deleted-86ba53fe-cce2-4789-bba6-f5c6dc63300c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:00:48 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Preparing to wait for external event volume-reimaged-5de596b1-5e07-4efd-986b-2e7161d89cb8 {{(pid=73254) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:49 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Deleted allocations for instance c07824af-f4a5-4018-a1e5-40cb58643bc8
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e54502b-404e-4d4b-a340-27b427ec064a tempest-AttachSCSIVolumeTestJSON-1168386333 tempest-AttachSCSIVolumeTestJSON-1168386333-project-member] Lock "c07824af-f4a5-4018-a1e5-40cb58643bc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.085s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No event matching network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 in dict_keys([('volume-reimaged', '5de596b1-5e07-4efd-986b-2e7161d89cb8')]) {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 14 15:00:49 user nova-compute[73254]: WARNING nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state active and task_state rebuilding.
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No event matching network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 in dict_keys([('volume-reimaged', '5de596b1-5e07-4efd-986b-2e7161d89cb8')]) {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 14 15:00:49 user nova-compute[73254]: WARNING nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state active and task_state rebuilding.
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No event matching network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 in dict_keys([('volume-reimaged', '5de596b1-5e07-4efd-986b-2e7161d89cb8')]) {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 14 15:00:49 user nova-compute[73254]: WARNING nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state active and task_state rebuilding.
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-unplugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No event matching network-vif-unplugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 in dict_keys([('volume-reimaged', '5de596b1-5e07-4efd-986b-2e7161d89cb8')]) {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 14 15:00:49 user nova-compute[73254]: WARNING nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-unplugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state active and task_state rebuilding.
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No event matching network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 in dict_keys([('volume-reimaged', '5de596b1-5e07-4efd-986b-2e7161d89cb8')]) {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Aug 14 15:00:49 user nova-compute[73254]: WARNING nova.compute.manager [req-4a158c94-c198-43d7-a4ec-32c40e8fb031 req-04661d4d-432f-43c7-8123-ab9b66f5a094 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state active and task_state rebuilding.
Aug 14 15:00:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:00:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:00:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:00:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:00:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:00:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:00:56 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:00:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:00:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:01:00 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:01:00 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=6988MB free_disk=25.46976089477539GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 16996b6c-6d6e-4b51-88f3-0ca024e95639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0110dafc-b336-45bd-aade-0eb9ba632a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 94250a67-88b2-48ac-88ad-8b298cf66692 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance da915cb7-8ab5-4c65-928f-70e94811dd4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance fe35bcec-a10d-4554-8cd7-1a9d1a72f484 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 2d7ac783-716a-4c23-9466-fa7d5eae73a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0674641b-1cd6-43ba-9970-f3cdd88a2b59 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance fd27da65-077e-4bd1-83fa-350928ca1478 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 244d32a6-c532-4e7e-84dd-b747a7a05c4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:01:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:01:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:01 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:01:01 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:01:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:01:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.476s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025247.300644, c07824af-f4a5-4018-a1e5-40cb58643bc8 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:01:02 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] VM Stopped (Lifecycle Event)
Aug 14 15:01:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7630c379-981e-4b16-a1f0-6b5a903ba185 None None] [instance: c07824af-f4a5-4018-a1e5-40cb58643bc8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025247.3316596, 0674641b-1cd6-43ba-9970-f3cdd88a2b59 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:01:02 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] VM Stopped (Lifecycle Event)
Aug 14 15:01:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-85a4618d-b931-4e86-9267-d814bd989a0e None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Updating instance_info_cache with network_info: [{"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-94250a67-88b2-48ac-88ad-8b298cf66692" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f req-789c5daf-7a89-4011-8dcd-e8701f9b58a5 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event volume-reimaged-5de596b1-5e07-4efd-986b-2e7161d89cb8 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f req-789c5daf-7a89-4011-8dcd-e8701f9b58a5 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f req-789c5daf-7a89-4011-8dcd-e8701f9b58a5 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f req-789c5daf-7a89-4011-8dcd-e8701f9b58a5 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f req-789c5daf-7a89-4011-8dcd-e8701f9b58a5 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Processing event volume-reimaged-5de596b1-5e07-4efd-986b-2e7161d89cb8 {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 14 15:01:06 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:01:06 user nova-compute[73254]: INFO nova.virt.block_device [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Booting with volume 5de596b1-5e07-4efd-986b-2e7161d89cb8 at /dev/vda
Aug 14 15:01:06 user nova-compute[73254]: DEBUG os_brick.utils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:01:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[097e0978-2df7-48ef-9f7f-fbc2230543a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0801d6b-1a6f-4d8e-91ba-200ed2164ab0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc01de7-223b-4b48-b4d7-2be95a333705]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0c784f-0f66-4a2d-927b-3ac2201ac6fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:01:07 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:01:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a29d64-f5fa-43ed-a6ac-d44f641b2f1c]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG os_brick.utils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Updating existing volume attachment record: 7f53ba40-195a-4707-a472-3ec673bc75ad {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:01:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-f0bbfa7f-b3d5-4230-ad21-5bd2a085b56b req-2172587c-f9a8-4931-a538-bcd219456ff2 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-changed-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-f0bbfa7f-b3d5-4230-ad21-5bd2a085b56b req-2172587c-f9a8-4931-a538-bcd219456ff2 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing instance network info cache due to event network-changed-2eaf6d44-2959-46a2-8439-9d1774481a00. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:01:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f0bbfa7f-b3d5-4230-ad21-5bd2a085b56b req-2172587c-f9a8-4931-a538-bcd219456ff2 service nova] Acquiring lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:01:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f0bbfa7f-b3d5-4230-ad21-5bd2a085b56b req-2172587c-f9a8-4931-a538-bcd219456ff2 service nova] Acquired lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:01:11 user nova-compute[73254]: DEBUG nova.network.neutron [req-f0bbfa7f-b3d5-4230-ad21-5bd2a085b56b req-2172587c-f9a8-4931-a538-bcd219456ff2 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Refreshing network info cache for port 2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:01:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-f0bbfa7f-b3d5-4230-ad21-5bd2a085b56b req-2172587c-f9a8-4931-a538-bcd219456ff2 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updated VIF entry in instance network info cache for port 2eaf6d44-2959-46a2-8439-9d1774481a00. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:01:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-f0bbfa7f-b3d5-4230-ad21-5bd2a085b56b req-2172587c-f9a8-4931-a538-bcd219456ff2 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [{"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:01:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f0bbfa7f-b3d5-4230-ad21-5bd2a085b56b req-2172587c-f9a8-4931-a538-bcd219456ff2 service nova] Releasing lock "refresh_cache-fd27da65-077e-4bd1-83fa-350928ca1478" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "fd27da65-077e-4bd1-83fa-350928ca1478" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:15 user nova-compute[73254]: INFO nova.compute.manager [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Terminating instance
Aug 14 15:01:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ed59389-1c9d-49d6-8e9f-3c2f96840c91 req-fc8bef5d-3547-49ae-b0d8-a164c2d67d34 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ed59389-1c9d-49d6-8e9f-3c2f96840c91 req-fc8bef5d-3547-49ae-b0d8-a164c2d67d34 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ed59389-1c9d-49d6-8e9f-3c2f96840c91 req-fc8bef5d-3547-49ae-b0d8-a164c2d67d34 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ed59389-1c9d-49d6-8e9f-3c2f96840c91 req-fc8bef5d-3547-49ae-b0d8-a164c2d67d34 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ed59389-1c9d-49d6-8e9f-3c2f96840c91 req-fc8bef5d-3547-49ae-b0d8-a164c2d67d34 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-unplugged-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ed59389-1c9d-49d6-8e9f-3c2f96840c91 req-fc8bef5d-3547-49ae-b0d8-a164c2d67d34 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-2eaf6d44-2959-46a2-8439-9d1774481a00 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-a7b96337-5df3-4e83-925f-f7f61cb9a1e0 req-2db094f2-3175-4146-a365-545326794815 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a7b96337-5df3-4e83-925f-f7f61cb9a1e0 req-2db094f2-3175-4146-a365-545326794815 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a7b96337-5df3-4e83-925f-f7f61cb9a1e0 req-2db094f2-3175-4146-a365-545326794815 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a7b96337-5df3-4e83-925f-f7f61cb9a1e0 req-2db094f2-3175-4146-a365-545326794815 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-a7b96337-5df3-4e83-925f-f7f61cb9a1e0 req-2db094f2-3175-4146-a365-545326794815 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-unplugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-a7b96337-5df3-4e83-925f-f7f61cb9a1e0 req-2db094f2-3175-4146-a365-545326794815 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-5a4c672e-2ed6-4408-90c7-f7c93a8c07d3 req-ddb4ab3a-37e2-4304-8603-ed8aff32187b service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5a4c672e-2ed6-4408-90c7-f7c93a8c07d3 req-ddb4ab3a-37e2-4304-8603-ed8aff32187b service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5a4c672e-2ed6-4408-90c7-f7c93a8c07d3 req-ddb4ab3a-37e2-4304-8603-ed8aff32187b service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5a4c672e-2ed6-4408-90c7-f7c93a8c07d3 req-ddb4ab3a-37e2-4304-8603-ed8aff32187b service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-5a4c672e-2ed6-4408-90c7-f7c93a8c07d3 req-ddb4ab3a-37e2-4304-8603-ed8aff32187b service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-unplugged-74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-5a4c672e-2ed6-4408-90c7-f7c93a8c07d3 req-ddb4ab3a-37e2-4304-8603-ed8aff32187b service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-74253df8-144f-4a08-9379-bc9175400d53 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:01:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Creating image(s)
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Ensure instance console log exists: /opt/stack/data/nova/instances/0674641b-1cd6-43ba-9970-f3cdd88a2b59/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Start _get_guest_xml network_info=[{"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7f53ba40-195a-4707-a472-3ec673bc75ad', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLqsucOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0674641b-1cd6-43ba-9970-f3cdd88a2b59', 'attached_at': '', 'detached_at': '', 'volume_id': '5de596b1-5e07-4efd-986b-2e7161d89cb8', 'serial': '5de596b1-5e07-4efd-986b-2e7161d89cb8'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 15:01:16 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0674641b-1cd6-43ba-9970-f3cdd88a2b59 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLqsucOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:01:16 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:01:16 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:01:16 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[66af66b5-5935-4824-8236-76d269ddeb99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:01:16 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18c10a5-b4a0-4f80-ae1d-b884e0a7b694]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8] added
Aug 14 15:01:16 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5beb1b-47e4-4ea5-b08a-eed784b1121b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b91e94f-fd42-4a79-9959-22da9ac7adc5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLqsucOV {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XLqsucOV" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4db0c4-ff29-483d-9cf9-726c4aa40900]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XLqsucOV'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[169a4ee6-c87a-40e0-9e66-3d95b065e05d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6c0e37-a889-4716-b661-051cc29f850e]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:01:16 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:01:16 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:01:16 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:01:16 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:01:16 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:01:16 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.116s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[196fd28a-a7aa-4e14-ab1f-f4162618aa56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260]
Aug 14 15:01:16 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260] successful.
Aug 14 15:01:16 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[331939e8-f484-4988-9749-84f732bb6cda]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8baed39d-b0be-4556-a1cb-183eda3cae2f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:16 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:01:16 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:01:16 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:01:16 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:16 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:01:16 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:01:16 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:01:16 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.396s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92894ed-db95-47ea-b5af-e279402b1a79]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLqsucOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:01:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Instance destroyed successfully.
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.objects.instance [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lazy-loading 'resources' on Instance uuid fd27da65-077e-4bd1-83fa-350928ca1478 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:08:1a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf6d44-2959-46a2-8439-9d1774481a00,network=Network(8191f256-1f60-412a-921b-245ea7d1e02e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf6d44-29') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:08:1a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf6d44-2959-46a2-8439-9d1774481a00,network=Network(8191f256-1f60-412a-921b-245ea7d1e02e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf6d44-29') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eaf6d44-29, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: INFO os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:08:1a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf6d44-2959-46a2-8439-9d1774481a00,network=Network(8191f256-1f60-412a-921b-245ea7d1e02e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf6d44-29')
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2c:e2,bridge_name='br-int',has_traffic_filtering=True,id=75c5a7e8-55ff-4d62-938c-2d2cea41507c,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap75c5a7e8-55') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2c:e2,bridge_name='br-int',has_traffic_filtering=True,id=75c5a7e8-55ff-4d62-938c-2d2cea41507c,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap75c5a7e8-55') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75c5a7e8-55, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: INFO os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:2c:e2,bridge_name='br-int',has_traffic_filtering=True,id=75c5a7e8-55ff-4d62-938c-2d2cea41507c,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap75c5a7e8-55')
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:21:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d4de0bf-83') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:21:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d4de0bf-83') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d4de0bf-83, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: INFO os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:21:1e,bridge_name='br-int',has_traffic_filtering=True,id=1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap1d4de0bf-83')
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e4:5d,bridge_name='br-int',has_traffic_filtering=True,id=51b6eb3b-b190-4421-880e-846dce087fe2,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b6eb3b-b1') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e4:5d,bridge_name='br-int',has_traffic_filtering=True,id=51b6eb3b-b190-4421-880e-846dce087fe2,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b6eb3b-b1') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51b6eb3b-b1, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: INFO os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:e4:5d,bridge_name='br-int',has_traffic_filtering=True,id=51b6eb3b-b190-4421-880e-846dce087fe2,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51b6eb3b-b1')
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3a:e9,bridge_name='br-int',has_traffic_filtering=True,id=74253df8-144f-4a08-9379-bc9175400d53,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74253df8-14') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3a:e9,bridge_name='br-int',has_traffic_filtering=True,id=74253df8-144f-4a08-9379-bc9175400d53,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74253df8-14') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74253df8-14, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: INFO os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:3a:e9,bridge_name='br-int',has_traffic_filtering=True,id=74253df8-144f-4a08-9379-bc9175400d53,network=Network(990a2d20-bcbc-46b7-b8c1-cbcabaa76b83),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74253df8-14')
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:72:ee,bridge_name='br-int',has_traffic_filtering=True,id=3b4b50f8-90fa-4a58-8381-240f5ab9e860,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b50f8-90') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:72:ee,bridge_name='br-int',has_traffic_filtering=True,id=3b4b50f8-90fa-4a58-8381-240f5ab9e860,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b50f8-90') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b4b50f8-90, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: INFO os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:72:ee,bridge_name='br-int',has_traffic_filtering=True,id=3b4b50f8-90fa-4a58-8381-240f5ab9e860,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b4b50f8-90')
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:59:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1800848975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1800848975',id=10,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAgK6i7r5PC5QYwMbha5lKMUjEVuuv6VaQEPrA8HKZVISpqw3o6VAXXCdG9pXR3EqrDItYpPUf4GnimsMGO5kJV7ibl/sWa1dtT7EZZll7Rm5Rwzz7vzLovBSIE+b+Zrg==',key_name='tempest-keypair-683156636',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='811e73c9bf0a45179efab5cdaced116b',ramdisk_id='',reservation_id='r-8z0vlp98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-483413375',owner_user_name='tempest-TaggedBootDevicesTest-483413375-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d4b513a9757044a98bf3b1f726117e4f',uuid=fd27da65-077e-4bd1-83fa-350928ca1478,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converting VIF {"id": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "address": "fa:16:3e:72:6f:77", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2b94e12-77", "ovs_interfaceid": "c2b94e12-77ee-4db0-bcbd-921903a8f883", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=c2b94e12-77ee-4db0-bcbd-921903a8f883,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b94e12-77') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=c2b94e12-77ee-4db0-bcbd-921903a8f883,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b94e12-77') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2b94e12-77, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:17 user nova-compute[73254]: INFO os_vif [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:6f:77,bridge_name='br-int',has_traffic_filtering=True,id=c2b94e12-77ee-4db0-bcbd-921903a8f883,network=Network(47e089b2-7274-42a8-b232-932da1b012eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2b94e12-77')
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBHJXqpz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:01:17 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:17 user nova-compute[73254]: WARNING nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-2eaf6d44-2959-46a2-8439-9d1774481a00 for instance with vm_state active and task_state deleting.
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-unplugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:17 user nova-compute[73254]: WARNING nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-3b4b50f8-90fa-4a58-8381-240f5ab9e860 for instance with vm_state active and task_state deleting.
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-unplugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:17 user nova-compute[73254]: WARNING nova.compute.manager [req-9b35b18c-b8c3-4656-ad92-1498f7b723f7 req-4236a8b2-daf8-4ea0-9b1d-0096d2495cc5 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-c2b94e12-77ee-4db0-bcbd-921903a8f883 for instance with vm_state active and task_state deleting.
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:17 user nova-compute[73254]: WARNING nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-75c5a7e8-55ff-4d62-938c-2d2cea41507c for instance with vm_state active and task_state deleting.
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-unplugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:17 user nova-compute[73254]: WARNING nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1 for instance with vm_state active and task_state deleting.
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-unplugged-51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-unplugged-51b6eb3b-b190-4421-880e-846dce087fe2 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:17 user nova-compute[73254]: WARNING nova.compute.manager [req-f6718a5d-d786-45fe-9833-36ec7edafd23 req-41b4c9f0-1ced-4de0-a97f-ba15d2bac0ce service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-51b6eb3b-b190-4421-880e-846dce087fe2 for instance with vm_state active and task_state deleting.
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '23835613132623436', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835613132623436', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.621s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd2001d-cbce-4da8-8f3d-fe750222ad11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T14:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-296607428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1973214659',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFl33XV+x9ts4rv7WJNVvYshjSa8TNqiIrMQzBrp0O6ibe77tIbQntCMYwdBaWlciKrpx8xErIU9j4DjFDlicSBbUrowd40KRU/vV0pPoHS0beUaHWL5ciQBFkq3LACXTg==',key_name='tempest-keypair-1229858273',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:59:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b96039e862a54a568460bdc32c225857',ramdisk_id='',reservation_id='r-ta92if1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-446563179',owner_user_name='tempest-ServerActionsV293TestJSON-446563179-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39db94ce446a44e6941ad7c0b7eab92d',uuid=0674641b-1cd6-43ba-9970-f3cdd88a2b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converting VIF {"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:01:17 user nova-compute[73254]:   <uuid>0674641b-1cd6-43ba-9970-f3cdd88a2b59</uuid>
Aug 14 15:01:17 user nova-compute[73254]:   <name>instance-00000009</name>
Aug 14 15:01:17 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:01:17 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:01:17 user nova-compute[73254]:   <metadata>
Aug 14 15:01:17 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:01:17 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:01:17 user nova-compute[73254]:       <nova:name>tempest-ServerActionsV293TestJSON-server-296607428</nova:name>
Aug 14 15:01:17 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:01:16</nova:creationTime>
Aug 14 15:01:17 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:01:17 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:01:17 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:01:17 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:01:17 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:01:17 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:01:17 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:01:17 user nova-compute[73254]:       <nova:owner>
Aug 14 15:01:17 user nova-compute[73254]:         <nova:user uuid="39db94ce446a44e6941ad7c0b7eab92d">tempest-ServerActionsV293TestJSON-446563179-project-member</nova:user>
Aug 14 15:01:17 user nova-compute[73254]:         <nova:project uuid="b96039e862a54a568460bdc32c225857">tempest-ServerActionsV293TestJSON-446563179</nova:project>
Aug 14 15:01:17 user nova-compute[73254]:       </nova:owner>
Aug 14 15:01:17 user nova-compute[73254]:       <nova:ports>
Aug 14 15:01:17 user nova-compute[73254]:         <nova:port uuid="ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36">
Aug 14 15:01:17 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 15:01:17 user nova-compute[73254]:         </nova:port>
Aug 14 15:01:17 user nova-compute[73254]:       </nova:ports>
Aug 14 15:01:17 user nova-compute[73254]:     </nova:instance>
Aug 14 15:01:17 user nova-compute[73254]:   </metadata>
Aug 14 15:01:17 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:01:17 user nova-compute[73254]:     <system>
Aug 14 15:01:17 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:01:17 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:01:17 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:01:17 user nova-compute[73254]:       <entry name="serial">0674641b-1cd6-43ba-9970-f3cdd88a2b59</entry>
Aug 14 15:01:17 user nova-compute[73254]:       <entry name="uuid">0674641b-1cd6-43ba-9970-f3cdd88a2b59</entry>
Aug 14 15:01:17 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:01:17 user nova-compute[73254]:     </system>
Aug 14 15:01:17 user nova-compute[73254]:   </sysinfo>
Aug 14 15:01:17 user nova-compute[73254]:   <os>
Aug 14 15:01:17 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:01:17 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:01:17 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:01:17 user nova-compute[73254]:   </os>
Aug 14 15:01:17 user nova-compute[73254]:   <features>
Aug 14 15:01:17 user nova-compute[73254]:     <acpi/>
Aug 14 15:01:17 user nova-compute[73254]:     <apic/>
Aug 14 15:01:17 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:01:17 user nova-compute[73254]:   </features>
Aug 14 15:01:17 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:01:17 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:01:17 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:01:17 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:01:17 user nova-compute[73254]:   </clock>
Aug 14 15:01:17 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:01:17 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:01:17 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:01:17 user nova-compute[73254]:   </cpu>
Aug 14 15:01:17 user nova-compute[73254]:   <devices>
Aug 14 15:01:17 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:01:17 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:01:17 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 15:01:17 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:01:17 user nova-compute[73254]:       <serial>5de596b1-5e07-4efd-986b-2e7161d89cb8</serial>
Aug 14 15:01:17 user nova-compute[73254]:     </disk>
Aug 14 15:01:17 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:01:17 user nova-compute[73254]:       <mac address="fa:16:3e:f4:f8:9a"/>
Aug 14 15:01:17 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:01:17 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:01:17 user nova-compute[73254]:       <target dev="tapac8d1a73-4e"/>
Aug 14 15:01:17 user nova-compute[73254]:     </interface>
Aug 14 15:01:17 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:01:17 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/0674641b-1cd6-43ba-9970-f3cdd88a2b59/console.log" append="off"/>
Aug 14 15:01:17 user nova-compute[73254]:     </serial>
Aug 14 15:01:17 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:01:17 user nova-compute[73254]:     <video>
Aug 14 15:01:17 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:01:17 user nova-compute[73254]:     </video>
Aug 14 15:01:17 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:01:17 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:01:17 user nova-compute[73254]:     </rng>
Aug 14 15:01:17 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:01:17 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:01:17 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:01:17 user nova-compute[73254]:     </memballoon>
Aug 14 15:01:17 user nova-compute[73254]:   </devices>
Aug 14 15:01:17 user nova-compute[73254]: </domain>
Aug 14 15:01:17 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T14:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-296607428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1973214659',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFl33XV+x9ts4rv7WJNVvYshjSa8TNqiIrMQzBrp0O6ibe77tIbQntCMYwdBaWlciKrpx8xErIU9j4DjFDlicSBbUrowd40KRU/vV0pPoHS0beUaHWL5ciQBFkq3LACXTg==',key_name='tempest-keypair-1229858273',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:59:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b96039e862a54a568460bdc32c225857',ramdisk_id='',reservation_id='r-ta92if1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-446563179',owner_user_name='tempest-ServerActionsV293TestJSON-446563179-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:01:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39db94ce446a44e6941ad7c0b7eab92d',uuid=0674641b-1cd6-43ba-9970-f3cdd88a2b59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converting VIF {"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_vif [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ab9297-1536-4191-92ac-bb123e3b387d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:17 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:01:17 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:01:17 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:01:17 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:17 user nova-compute[73254]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e (non-flash)
Aug 14 15:01:17 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:01:17 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:01:17 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648692c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapac8d1a73-4e, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapac8d1a73-4e, col_values=(('external_ids', {'iface-id': 'ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:f8:9a', 'vm-uuid': '0674641b-1cd6-43ba-9970-f3cdd88a2b59'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:17 user nova-compute[73254]: INFO os_vif [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e')
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4c236a-37cd-46db-a619-4090e1b4129f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8141eb31-5ce6-4bb7-95be-ef133894b1a8]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d3ba83-137f-47d4-adf6-30a35a6330a2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] No VIF found with MAC fa:16:3e:f4:f8:9a, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e95096-4b44-48de-985c-d6f6a5eaac07]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d3ed6d-c24f-4166-a114-a25b976d545d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d68bbf-5fd5-4fd7-bfe3-abb2c6ae6ed6]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e, portal: 172.16.0.220,3260]
Aug 14 15:01:18 user nova-compute[73254]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e, portal: 172.16.0.220,3260] successful.
Aug 14 15:01:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-72fdb764-bde3-4939-a4ba-174d63f07551 req-478c7ccd-35f5-406a-8757-988eaeb92653 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-plugged-74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72fdb764-bde3-4939-a4ba-174d63f07551 req-478c7ccd-35f5-406a-8757-988eaeb92653 service nova] Acquiring lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72fdb764-bde3-4939-a4ba-174d63f07551 req-478c7ccd-35f5-406a-8757-988eaeb92653 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72fdb764-bde3-4939-a4ba-174d63f07551 req-478c7ccd-35f5-406a-8757-988eaeb92653 service nova] Lock "fd27da65-077e-4bd1-83fa-350928ca1478-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-72fdb764-bde3-4939-a4ba-174d63f07551 req-478c7ccd-35f5-406a-8757-988eaeb92653 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] No waiting events found dispatching network-vif-plugged-74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:18 user nova-compute[73254]: WARNING nova.compute.manager [req-72fdb764-bde3-4939-a4ba-174d63f07551 req-478c7ccd-35f5-406a-8757-988eaeb92653 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received unexpected event network-vif-plugged-74253df8-144f-4a08-9379-bc9175400d53 for instance with vm_state active and task_state deleting.
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e36db3d-04db-475b-8d2e-8afd9656594e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc84ce9-32db-408c-a715-85db821297f1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] <== disconnect_volume: return (908ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjYaEIbo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:01:18 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b03fe99-2858-40f4-8d21-c7bdbb2dcf46]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c9259f-eb38-47e8-8604-932908a990e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:18 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:01:18 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:01:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:18 user nova-compute[73254]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 (non-flash)
Aug 14 15:01:18 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:01:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd668327010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91'): ({'sdd'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Removing single pathed devices sdd {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0673440b-ea0c-4480-84b2-53c0dabbfa4e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f84757-c550-4565-80d8-0368df463b5d]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Flushing IO for device /dev/sdd {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3f2a24-20c9-48d6-8569-ceda7d7a7fff]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b5ab88-c6c4-4703-b6e3-5121915aa6b8]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[106b28b4-b4c1-4dc8-91ce-4726b7ee0f3e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[68130e32-a333-437a-8d78-1134dbef1135]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91, portal: 172.16.0.220,3260]
Aug 14 15:01:18 user nova-compute[73254]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91, portal: 172.16.0.220,3260] successful.
Aug 14 15:01:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23e4a28b-2368-4b63-a629-ed7ef5615f91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b2aebd-e50e-4a76-841d-941aff89aaf7]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] <== disconnect_volume: return (287ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CRjlayAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:01:18 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ebbdc2-faab-4b21-be28-11f2881d2a88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb32dda0-070a-40da-83e4-d8aa64c51ffb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:18 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:01:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:18 user nova-compute[73254]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 (non-flash)
Aug 14 15:01:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648693d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8'): ({'sde'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Removing single pathed devices sde {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a677fdf0-8254-4048-8e9f-59741c325b3e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[54de07a3-18ab-43e1-ab2b-7fb85731d269]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Flushing IO for device /dev/sde {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[988d5837-1698-404d-92b1-40de687fdcbf]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c63b4d-9b8f-4522-9680-8b5422d94ddf]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] SCSI volumes sde have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7719f65-63d0-41af-9f2f-137f09ba555a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faa836a-df5f-43e6-80ae-a4df80a62183]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8, portal: 172.16.0.220,3260]
Aug 14 15:01:18 user nova-compute[73254]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8, portal: 172.16.0.220,3260] successful.
Aug 14 15:01:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b748f02-008f-4901-8c7e-1a6257dd9ef8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c8e461-2fbd-4f3e-901e-df94abcf63f8]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] <== disconnect_volume: return (259ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:01:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Deleting instance files /opt/stack/data/nova/instances/fd27da65-077e-4bd1-83fa-350928ca1478_del
Aug 14 15:01:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Deletion of /opt/stack/data/nova/instances/fd27da65-077e-4bd1-83fa-350928ca1478_del complete
Aug 14 15:01:18 user nova-compute[73254]: INFO nova.compute.manager [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Took 3.60 seconds to destroy the instance on the hypervisor.
Aug 14 15:01:18 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:01:18 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No waiting events found dispatching network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:19 user nova-compute[73254]: WARNING nova.compute.manager [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 15:01:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No waiting events found dispatching network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:19 user nova-compute[73254]: WARNING nova.compute.manager [req-9e8d3a3f-e707-4386-bc4b-b73649676d0a req-f562151d-1af2-4933-bca4-c6b981fd2460 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 15:01:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-00356c24-4506-444f-b479-16c739e944e9 req-48e675dc-ea03-4ac9-a2e9-533c096191c0 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-deleted-c2b94e12-77ee-4db0-bcbd-921903a8f883 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:20 user nova-compute[73254]: INFO nova.compute.manager [req-00356c24-4506-444f-b479-16c739e944e9 req-48e675dc-ea03-4ac9-a2e9-533c096191c0 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Neutron deleted interface c2b94e12-77ee-4db0-bcbd-921903a8f883; detaching it from the instance and deleting it from the info cache
Aug 14 15:01:20 user nova-compute[73254]: DEBUG nova.network.neutron [req-00356c24-4506-444f-b479-16c739e944e9 req-48e675dc-ea03-4ac9-a2e9-533c096191c0 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [{"id": "2eaf6d44-2959-46a2-8439-9d1774481a00", "address": "fa:16:3e:38:08:1a", "network": {"id": "8191f256-1f60-412a-921b-245ea7d1e02e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1348980241-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf6d44-29", "ovs_interfaceid": "2eaf6d44-2959-46a2-8439-9d1774481a00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "address": "fa:16:3e:bb:2c:e2", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c5a7e8-55", "ovs_interfaceid": "75c5a7e8-55ff-4d62-938c-2d2cea41507c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "address": "fa:16:3e:56:21:1e", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d4de0bf-83", "ovs_interfaceid": "1d4de0bf-8306-44e7-8789-a9c1ac2b0ce1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "51b6eb3b-b190-4421-880e-846dce087fe2", "address": "fa:16:3e:ea:e4:5d", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51b6eb3b-b1", "ovs_interfaceid": "51b6eb3b-b190-4421-880e-846dce087fe2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "74253df8-144f-4a08-9379-bc9175400d53", "address": "fa:16:3e:8b:3a:e9", "network": {"id": "990a2d20-bcbc-46b7-b8c1-cbcabaa76b83", "bridge": "br-int", "label": "tempest-device-tagging-net1-1678523088", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74253df8-14", "ovs_interfaceid": "74253df8-144f-4a08-9379-bc9175400d53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "address": "fa:16:3e:4a:72:ee", "network": {"id": "47e089b2-7274-42a8-b232-932da1b012eb", "bridge": "br-int", "label": "tempest-device-tagging-net2-2048206853", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "811e73c9bf0a45179efab5cdaced116b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b4b50f8-90", "ovs_interfaceid": "3b4b50f8-90fa-4a58-8381-240f5ab9e860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:01:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-00356c24-4506-444f-b479-16c739e944e9 req-48e675dc-ea03-4ac9-a2e9-533c096191c0 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Detach interface failed, port_id=c2b94e12-77ee-4db0-bcbd-921903a8f883, reason: Instance fd27da65-077e-4bd1-83fa-350928ca1478 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025281.2459404, 0674641b-1cd6-43ba-9970-f3cdd88a2b59 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:01:21 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] VM Resumed (Lifecycle Event)
Aug 14 15:01:21 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Instance spawned successfully.
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:01:21 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025281.2461574, 0674641b-1cd6-43ba-9970-f3cdd88a2b59 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:01:21 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] VM Started (Lifecycle Event)
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:01:21 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73254) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 15:01:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e1f9759e-bdb8-4f54-b677-d3c183c2da4f tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:22 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:01:22 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Took 3.75 seconds to deallocate network for instance.
Aug 14 15:01:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-ccef0851-f728-41a1-a647-225d02910a91 req-184012d2-f5d7-4c77-b286-fcff63b813d2 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-deleted-2eaf6d44-2959-46a2-8439-9d1774481a00 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-ccef0851-f728-41a1-a647-225d02910a91 req-184012d2-f5d7-4c77-b286-fcff63b813d2 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-deleted-51b6eb3b-b190-4421-880e-846dce087fe2 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-ccef0851-f728-41a1-a647-225d02910a91 req-184012d2-f5d7-4c77-b286-fcff63b813d2 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-deleted-3b4b50f8-90fa-4a58-8381-240f5ab9e860 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-ccef0851-f728-41a1-a647-225d02910a91 req-184012d2-f5d7-4c77-b286-fcff63b813d2 service nova] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Received event network-vif-deleted-74253df8-144f-4a08-9379-bc9175400d53 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:24 user nova-compute[73254]: INFO nova.compute.manager [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Took 2.35 seconds to detach 3 volumes for instance.
Aug 14 15:01:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:25 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:01:25 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:01:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:25 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Deleted allocations for instance fd27da65-077e-4bd1-83fa-350928ca1478
Aug 14 15:01:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-635e41bc-d257-4491-a467-17e85c0df633 tempest-TaggedBootDevicesTest-483413375 tempest-TaggedBootDevicesTest-483413375-project-member] Lock "fd27da65-077e-4bd1-83fa-350928ca1478" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.202s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:31 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025276.8049047, fd27da65-077e-4bd1-83fa-350928ca1478 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:01:31 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] VM Stopped (Lifecycle Event)
Aug 14 15:01:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-87bcf4c1-3f14-4c3f-991d-50d4e211bdfd None None] [instance: fd27da65-077e-4bd1-83fa-350928ca1478] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "73803036-4ad2-42b7-8d7e-40d2a97880fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Acquiring lock "94250a67-88b2-48ac-88ad-8b298cf66692" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "94250a67-88b2-48ac-88ad-8b298cf66692" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Acquiring lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:36 user nova-compute[73254]: INFO nova.compute.manager [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Terminating instance
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:01:36 user nova-compute[73254]: INFO nova.compute.claims [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Claim successful on node user
Aug 14 15:01:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-a18f54d7-f68d-4798-94ad-877c032e3757 req-82038527-2ba1-42dc-8d6f-dfdbc09fe92c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received event network-vif-unplugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a18f54d7-f68d-4798-94ad-877c032e3757 req-82038527-2ba1-42dc-8d6f-dfdbc09fe92c service nova] Acquiring lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a18f54d7-f68d-4798-94ad-877c032e3757 req-82038527-2ba1-42dc-8d6f-dfdbc09fe92c service nova] Lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a18f54d7-f68d-4798-94ad-877c032e3757 req-82038527-2ba1-42dc-8d6f-dfdbc09fe92c service nova] Lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-a18f54d7-f68d-4798-94ad-877c032e3757 req-82038527-2ba1-42dc-8d6f-dfdbc09fe92c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] No waiting events found dispatching network-vif-unplugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-a18f54d7-f68d-4798-94ad-877c032e3757 req-82038527-2ba1-42dc-8d6f-dfdbc09fe92c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received event network-vif-unplugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.563s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.network.neutron [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:01:36 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:01:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.policy [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0faec8d574c343b5a9105c5224881b80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60e4479f583d4794b615fe3e28d8ee7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:01:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Instance destroyed successfully.
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lazy-loading 'resources' on Instance uuid 94250a67-88b2-48ac-88ad-8b298cf66692 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-658009832',display_name='tempest-VolumesAssistedSnapshotsTest-server-658009832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-658009832',id=5,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCPNyoN74IhOsW38/V4ypgLjaxOix1DdVCpNNg7BB7sX38BLmQKYBxA7jBMIQVXIufPbU/rL+qnXzk+GgTQ4z5KOXgCv3gMBYvOqWE+BKvSRxMRaC/Po2roTdLnDqDKSA==',key_name='tempest-keypair-1797260486',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fb17959991948c5a5ec5ad23198e31f',ramdisk_id='',reservation_id='r-9yxje53v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-374551747',owner_user_name='tempest-VolumesAssistedSnapshotsTest-374551747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:58:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fb0652fd2e20423981a7173e0f7e9ecb',uuid=94250a67-88b2-48ac-88ad-8b298cf66692,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Converting VIF {"id": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "address": "fa:16:3e:4d:bb:ac", "network": {"id": "8e542012-1424-486e-9338-188985d6bf35", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-20781334-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fb17959991948c5a5ec5ad23198e31f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83dbfd08-9b", "ovs_interfaceid": "83dbfd08-9b03-4c15-a4ad-52c48518c446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:bb:ac,bridge_name='br-int',has_traffic_filtering=True,id=83dbfd08-9b03-4c15-a4ad-52c48518c446,network=Network(8e542012-1424-486e-9338-188985d6bf35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dbfd08-9b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG os_vif [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:bb:ac,bridge_name='br-int',has_traffic_filtering=True,id=83dbfd08-9b03-4c15-a4ad-52c48518c446,network=Network(8e542012-1424-486e-9338-188985d6bf35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dbfd08-9b') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83dbfd08-9b, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:37 user nova-compute[73254]: INFO os_vif [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:bb:ac,bridge_name='br-int',has_traffic_filtering=True,id=83dbfd08-9b03-4c15-a4ad-52c48518c446,network=Network(8e542012-1424-486e-9338-188985d6bf35),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83dbfd08-9b')
Aug 14 15:01:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Deleting instance files /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692_del
Aug 14 15:01:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Deletion of /opt/stack/data/nova/instances/94250a67-88b2-48ac-88ad-8b298cf66692_del complete
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:01:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Creating image(s)
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "/opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "/opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "/opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:37 user nova-compute[73254]: INFO nova.compute.manager [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.203s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk 1073741824" returned: 0 in 0.056s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.217s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Cannot resize image /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.objects.instance [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lazy-loading 'migration_context' on Instance uuid 73803036-4ad2-42b7-8d7e-40d2a97880fe {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Ensure instance console log exists: /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Successfully created port: 30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:01:38 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Took 1.17 seconds to deallocate network for instance.
Aug 14 15:01:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-338fe60d-9a68-4dd2-8c12-4d8d75eabc28 req-12f27019-f6e2-4ad9-9bd2-e6d2672b542c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received event network-vif-plugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-338fe60d-9a68-4dd2-8c12-4d8d75eabc28 req-12f27019-f6e2-4ad9-9bd2-e6d2672b542c service nova] Acquiring lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-338fe60d-9a68-4dd2-8c12-4d8d75eabc28 req-12f27019-f6e2-4ad9-9bd2-e6d2672b542c service nova] Lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-338fe60d-9a68-4dd2-8c12-4d8d75eabc28 req-12f27019-f6e2-4ad9-9bd2-e6d2672b542c service nova] Lock "94250a67-88b2-48ac-88ad-8b298cf66692-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-338fe60d-9a68-4dd2-8c12-4d8d75eabc28 req-12f27019-f6e2-4ad9-9bd2-e6d2672b542c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] No waiting events found dispatching network-vif-plugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:38 user nova-compute[73254]: WARNING nova.compute.manager [req-338fe60d-9a68-4dd2-8c12-4d8d75eabc28 req-12f27019-f6e2-4ad9-9bd2-e6d2672b542c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received unexpected event network-vif-plugged-83dbfd08-9b03-4c15-a4ad-52c48518c446 for instance with vm_state deleted and task_state None.
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-338fe60d-9a68-4dd2-8c12-4d8d75eabc28 req-12f27019-f6e2-4ad9-9bd2-e6d2672b542c service nova] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Received event network-vif-deleted-83dbfd08-9b03-4c15-a4ad-52c48518c446 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Successfully updated port: 30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "refresh_cache-73803036-4ad2-42b7-8d7e-40d2a97880fe" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquired lock "refresh_cache-73803036-4ad2-42b7-8d7e-40d2a97880fe" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:01:38 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Deleted allocations for instance 94250a67-88b2-48ac-88ad-8b298cf66692
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-89a319f1-6ced-441c-946d-eba3a758b780 req-749f6afc-b54e-49a6-8458-3cafc606dae4 service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Received event network-changed-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-89a319f1-6ced-441c-946d-eba3a758b780 req-749f6afc-b54e-49a6-8458-3cafc606dae4 service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Refreshing instance network info cache due to event network-changed-30a6bca6-1a5c-4615-a1b2-b88f1fc59071. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-89a319f1-6ced-441c-946d-eba3a758b780 req-749f6afc-b54e-49a6-8458-3cafc606dae4 service nova] Acquiring lock "refresh_cache-73803036-4ad2-42b7-8d7e-40d2a97880fe" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:01:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5715138c-c7a3-4f69-a6e5-7126dbc70711 tempest-VolumesAssistedSnapshotsTest-374551747 tempest-VolumesAssistedSnapshotsTest-374551747-project-member] Lock "94250a67-88b2-48ac-88ad-8b298cf66692" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.679s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.network.neutron [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Updating instance_info_cache with network_info: [{"id": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "address": "fa:16:3e:50:8f:73", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a6bca6-1a", "ovs_interfaceid": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Releasing lock "refresh_cache-73803036-4ad2-42b7-8d7e-40d2a97880fe" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Instance network_info: |[{"id": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "address": "fa:16:3e:50:8f:73", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a6bca6-1a", "ovs_interfaceid": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-89a319f1-6ced-441c-946d-eba3a758b780 req-749f6afc-b54e-49a6-8458-3cafc606dae4 service nova] Acquired lock "refresh_cache-73803036-4ad2-42b7-8d7e-40d2a97880fe" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.network.neutron [req-89a319f1-6ced-441c-946d-eba3a758b780 req-749f6afc-b54e-49a6-8458-3cafc606dae4 service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Refreshing network info cache for port 30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Start _get_guest_xml network_info=[{"id": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "address": "fa:16:3e:50:8f:73", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a6bca6-1a", "ovs_interfaceid": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:01:39 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:01:39 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-443258490',display_name='tempest-VolumesAdminNegativeTest-server-443258490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-443258490',id=14,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e4479f583d4794b615fe3e28d8ee7f',ramdisk_id='',reservation_id='r-i5dyf49o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-656235791',owner_user_name='tempest-VolumesAdminNegativeTest-656235791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:01:37Z,user_data=None,user_id='0faec8d574c343b5a9105c5224881b80',uuid=73803036-4ad2-42b7-8d7e-40d2a97880fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "address": "fa:16:3e:50:8f:73", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a6bca6-1a", "ovs_interfaceid": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converting VIF {"id": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "address": "fa:16:3e:50:8f:73", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a6bca6-1a", "ovs_interfaceid": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:8f:73,bridge_name='br-int',has_traffic_filtering=True,id=30a6bca6-1a5c-4615-a1b2-b88f1fc59071,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a6bca6-1a') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.objects.instance [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lazy-loading 'pci_devices' on Instance uuid 73803036-4ad2-42b7-8d7e-40d2a97880fe {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:01:39 user nova-compute[73254]:   <uuid>73803036-4ad2-42b7-8d7e-40d2a97880fe</uuid>
Aug 14 15:01:39 user nova-compute[73254]:   <name>instance-0000000e</name>
Aug 14 15:01:39 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:01:39 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:01:39 user nova-compute[73254]:   <metadata>
Aug 14 15:01:39 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:01:39 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:01:39 user nova-compute[73254]:       <nova:name>tempest-VolumesAdminNegativeTest-server-443258490</nova:name>
Aug 14 15:01:39 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:01:39</nova:creationTime>
Aug 14 15:01:39 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:01:39 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:01:39 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:01:39 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:01:39 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:01:39 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:01:39 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:01:39 user nova-compute[73254]:       <nova:owner>
Aug 14 15:01:39 user nova-compute[73254]:         <nova:user uuid="0faec8d574c343b5a9105c5224881b80">tempest-VolumesAdminNegativeTest-656235791-project-member</nova:user>
Aug 14 15:01:39 user nova-compute[73254]:         <nova:project uuid="60e4479f583d4794b615fe3e28d8ee7f">tempest-VolumesAdminNegativeTest-656235791</nova:project>
Aug 14 15:01:39 user nova-compute[73254]:       </nova:owner>
Aug 14 15:01:39 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:01:39 user nova-compute[73254]:       <nova:ports>
Aug 14 15:01:39 user nova-compute[73254]:         <nova:port uuid="30a6bca6-1a5c-4615-a1b2-b88f1fc59071">
Aug 14 15:01:39 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 15:01:39 user nova-compute[73254]:         </nova:port>
Aug 14 15:01:39 user nova-compute[73254]:       </nova:ports>
Aug 14 15:01:39 user nova-compute[73254]:     </nova:instance>
Aug 14 15:01:39 user nova-compute[73254]:   </metadata>
Aug 14 15:01:39 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:01:39 user nova-compute[73254]:     <system>
Aug 14 15:01:39 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:01:39 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:01:39 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:01:39 user nova-compute[73254]:       <entry name="serial">73803036-4ad2-42b7-8d7e-40d2a97880fe</entry>
Aug 14 15:01:39 user nova-compute[73254]:       <entry name="uuid">73803036-4ad2-42b7-8d7e-40d2a97880fe</entry>
Aug 14 15:01:39 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:01:39 user nova-compute[73254]:     </system>
Aug 14 15:01:39 user nova-compute[73254]:   </sysinfo>
Aug 14 15:01:39 user nova-compute[73254]:   <os>
Aug 14 15:01:39 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:01:39 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:01:39 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:01:39 user nova-compute[73254]:   </os>
Aug 14 15:01:39 user nova-compute[73254]:   <features>
Aug 14 15:01:39 user nova-compute[73254]:     <acpi/>
Aug 14 15:01:39 user nova-compute[73254]:     <apic/>
Aug 14 15:01:39 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:01:39 user nova-compute[73254]:   </features>
Aug 14 15:01:39 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:01:39 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:01:39 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:01:39 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:01:39 user nova-compute[73254]:   </clock>
Aug 14 15:01:39 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:01:39 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:01:39 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:01:39 user nova-compute[73254]:   </cpu>
Aug 14 15:01:39 user nova-compute[73254]:   <devices>
Aug 14 15:01:39 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:01:39 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:01:39 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk"/>
Aug 14 15:01:39 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:01:39 user nova-compute[73254]:     </disk>
Aug 14 15:01:39 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:01:39 user nova-compute[73254]:       <mac address="fa:16:3e:50:8f:73"/>
Aug 14 15:01:39 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:01:39 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:01:39 user nova-compute[73254]:       <target dev="tap30a6bca6-1a"/>
Aug 14 15:01:39 user nova-compute[73254]:     </interface>
Aug 14 15:01:39 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:01:39 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/console.log" append="off"/>
Aug 14 15:01:39 user nova-compute[73254]:     </serial>
Aug 14 15:01:39 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:01:39 user nova-compute[73254]:     <video>
Aug 14 15:01:39 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:01:39 user nova-compute[73254]:     </video>
Aug 14 15:01:39 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:01:39 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:01:39 user nova-compute[73254]:     </rng>
Aug 14 15:01:39 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:01:39 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:01:39 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:01:39 user nova-compute[73254]:     </memballoon>
Aug 14 15:01:39 user nova-compute[73254]:   </devices>
Aug 14 15:01:39 user nova-compute[73254]: </domain>
Aug 14 15:01:39 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-443258490',display_name='tempest-VolumesAdminNegativeTest-server-443258490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-443258490',id=14,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60e4479f583d4794b615fe3e28d8ee7f',ramdisk_id='',reservation_id='r-i5dyf49o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-656235791',owner_user_name='tempest-VolumesAdminNegativeTest-656235791-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:01:37Z,user_data=None,user_id='0faec8d574c343b5a9105c5224881b80',uuid=73803036-4ad2-42b7-8d7e-40d2a97880fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "address": "fa:16:3e:50:8f:73", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a6bca6-1a", "ovs_interfaceid": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converting VIF {"id": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "address": "fa:16:3e:50:8f:73", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a6bca6-1a", "ovs_interfaceid": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:8f:73,bridge_name='br-int',has_traffic_filtering=True,id=30a6bca6-1a5c-4615-a1b2-b88f1fc59071,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a6bca6-1a') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG os_vif [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:8f:73,bridge_name='br-int',has_traffic_filtering=True,id=30a6bca6-1a5c-4615-a1b2-b88f1fc59071,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a6bca6-1a') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30a6bca6-1a, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30a6bca6-1a, col_values=(('external_ids', {'iface-id': '30a6bca6-1a5c-4615-a1b2-b88f1fc59071', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:8f:73', 'vm-uuid': '73803036-4ad2-42b7-8d7e-40d2a97880fe'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:39 user nova-compute[73254]: INFO os_vif [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:8f:73,bridge_name='br-int',has_traffic_filtering=True,id=30a6bca6-1a5c-4615-a1b2-b88f1fc59071,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a6bca6-1a')
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] No VIF found with MAC fa:16:3e:50:8f:73, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.network.neutron [req-89a319f1-6ced-441c-946d-eba3a758b780 req-749f6afc-b54e-49a6-8458-3cafc606dae4 service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Updated VIF entry in instance network info cache for port 30a6bca6-1a5c-4615-a1b2-b88f1fc59071. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG nova.network.neutron [req-89a319f1-6ced-441c-946d-eba3a758b780 req-749f6afc-b54e-49a6-8458-3cafc606dae4 service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Updating instance_info_cache with network_info: [{"id": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "address": "fa:16:3e:50:8f:73", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a6bca6-1a", "ovs_interfaceid": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:01:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-89a319f1-6ced-441c-946d-eba3a758b780 req-749f6afc-b54e-49a6-8458-3cafc606dae4 service nova] Releasing lock "refresh_cache-73803036-4ad2-42b7-8d7e-40d2a97880fe" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:01:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-daf52462-acac-4d7a-80ca-8e6a32df9704 req-0975f9ad-fd15-4411-b1ae-96c0bbf64d35 service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Received event network-vif-plugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-daf52462-acac-4d7a-80ca-8e6a32df9704 req-0975f9ad-fd15-4411-b1ae-96c0bbf64d35 service nova] Acquiring lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-daf52462-acac-4d7a-80ca-8e6a32df9704 req-0975f9ad-fd15-4411-b1ae-96c0bbf64d35 service nova] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-daf52462-acac-4d7a-80ca-8e6a32df9704 req-0975f9ad-fd15-4411-b1ae-96c0bbf64d35 service nova] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-daf52462-acac-4d7a-80ca-8e6a32df9704 req-0975f9ad-fd15-4411-b1ae-96c0bbf64d35 service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] No waiting events found dispatching network-vif-plugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:40 user nova-compute[73254]: WARNING nova.compute.manager [req-daf52462-acac-4d7a-80ca-8e6a32df9704 req-0975f9ad-fd15-4411-b1ae-96c0bbf64d35 service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Received unexpected event network-vif-plugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 for instance with vm_state building and task_state spawning.
Aug 14 15:01:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-e2803323-182f-4022-9b17-04c77f2f50ec req-e61faccd-ab69-40b3-acae-fc28e1550b8c service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-changed-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-e2803323-182f-4022-9b17-04c77f2f50ec req-e61faccd-ab69-40b3-acae-fc28e1550b8c service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Refreshing instance network info cache due to event network-changed-b2e5b202-0340-415c-940e-e8111a13d8fe. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e2803323-182f-4022-9b17-04c77f2f50ec req-e61faccd-ab69-40b3-acae-fc28e1550b8c service nova] Acquiring lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e2803323-182f-4022-9b17-04c77f2f50ec req-e61faccd-ab69-40b3-acae-fc28e1550b8c service nova] Acquired lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG nova.network.neutron [req-e2803323-182f-4022-9b17-04c77f2f50ec req-e61faccd-ab69-40b3-acae-fc28e1550b8c service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Refreshing network info cache for port b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG nova.network.neutron [req-e2803323-182f-4022-9b17-04c77f2f50ec req-e61faccd-ab69-40b3-acae-fc28e1550b8c service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updated VIF entry in instance network info cache for port b2e5b202-0340-415c-940e-e8111a13d8fe. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG nova.network.neutron [req-e2803323-182f-4022-9b17-04c77f2f50ec req-e61faccd-ab69-40b3-acae-fc28e1550b8c service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updating instance_info_cache with network_info: [{"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG nova.objects.instance [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'flavor' on Instance uuid 4b878d88-e5f3-41b9-a399-c2da1806e1fc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e2803323-182f-4022-9b17-04c77f2f50ec req-e61faccd-ab69-40b3-acae-fc28e1550b8c service nova] Releasing lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:01:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:42 user nova-compute[73254]: INFO nova.compute.manager [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Attaching volume 44215dd6-1d41-4511-8adf-9a349ecf55a2 to /dev/vdb
Aug 14 15:01:42 user nova-compute[73254]: DEBUG os_brick.utils [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc0bfd5-8405-4f72-be50-6bae135c943c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[acec0e65-9aef-4e61-979a-f3da059713be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c2b0fd-720f-4a86-9c06-566cdf0507d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae64e50e-c83b-4554-9560-2d850065293f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:01:42 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc6b80f-7e9b-4932-9ddf-02c2184b8c8b]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG os_brick.utils [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updating existing volume attachment record: ed8aa7e6-4e52-4523-978f-ceebd7b0ba4f {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:42 user nova-compute[73254]: INFO nova.compute.manager [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Terminating instance
Aug 14 15:01:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-f178f2e8-81b3-4385-9530-581242d26d62 req-5efcf7b2-3fd7-46eb-9ad9-2df16972c67d service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Received event network-vif-plugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f178f2e8-81b3-4385-9530-581242d26d62 req-5efcf7b2-3fd7-46eb-9ad9-2df16972c67d service nova] Acquiring lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f178f2e8-81b3-4385-9530-581242d26d62 req-5efcf7b2-3fd7-46eb-9ad9-2df16972c67d service nova] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f178f2e8-81b3-4385-9530-581242d26d62 req-5efcf7b2-3fd7-46eb-9ad9-2df16972c67d service nova] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-f178f2e8-81b3-4385-9530-581242d26d62 req-5efcf7b2-3fd7-46eb-9ad9-2df16972c67d service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] No waiting events found dispatching network-vif-plugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:42 user nova-compute[73254]: WARNING nova.compute.manager [req-f178f2e8-81b3-4385-9530-581242d26d62 req-5efcf7b2-3fd7-46eb-9ad9-2df16972c67d service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Received unexpected event network-vif-plugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 for instance with vm_state building and task_state spawning.
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025303.0068195, 73803036-4ad2-42b7-8d7e-40d2a97880fe => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] VM Resumed (Lifecycle Event)
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Instance spawned successfully.
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025303.0125146, 73803036-4ad2-42b7-8d7e-40d2a97880fe => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] VM Started (Lifecycle Event)
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.compute.manager [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Instance destroyed successfully.
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.objects.instance [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lazy-loading 'resources' on Instance uuid 244d32a6-c532-4e7e-84dd-b747a7a05c4b {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:59:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1756455064',display_name='tempest-ServersNegativeTestJSON-server-1756455064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1756455064',id=12,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:59:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd3bb025095b443d822303c387f0deca',ramdisk_id='',reservation_id='r-2y08kssz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-868064230',owner_user_name='tempest-ServersNegativeTestJSON-868064230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:59:59Z,user_data=None,user_id='8f6f7c760aea49c5a2914d1dbff90077',uuid=244d32a6-c532-4e7e-84dd-b747a7a05c4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "address": "fa:16:3e:d5:d1:15", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8069f888-3b", "ovs_interfaceid": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converting VIF {"id": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "address": "fa:16:3e:d5:d1:15", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8069f888-3b", "ovs_interfaceid": "8069f888-3b93-4c26-9ba8-6eb3ba6b053c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d1:15,bridge_name='br-int',has_traffic_filtering=True,id=8069f888-3b93-4c26-9ba8-6eb3ba6b053c,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8069f888-3b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG os_vif [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d1:15,bridge_name='br-int',has_traffic_filtering=True,id=8069f888-3b93-4c26-9ba8-6eb3ba6b053c,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8069f888-3b') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8069f888-3b, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:01:43 user nova-compute[73254]: INFO os_vif [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:d1:15,bridge_name='br-int',has_traffic_filtering=True,id=8069f888-3b93-4c26-9ba8-6eb3ba6b053c,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8069f888-3b')
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Deleting instance files /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b_del
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Deletion of /opt/stack/data/nova/instances/244d32a6-c532-4e7e-84dd-b747a7a05c4b_del complete
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.compute.manager [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Took 7.06 seconds to build instance.
Aug 14 15:01:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cbe34a7b-645f-40ae-a0b6-827e46dc6990 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.168s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.compute.manager [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Took 0.79 seconds to destroy the instance on the hypervisor.
Aug 14 15:01:43 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Received event network-vif-unplugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] Acquiring lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] No waiting events found dispatching network-vif-unplugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Received event network-vif-unplugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Received event network-vif-plugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] Acquiring lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] No waiting events found dispatching network-vif-plugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:01:43 user nova-compute[73254]: WARNING nova.compute.manager [req-16b29078-4bf0-4f88-a2b5-a96831182f29 req-88d7eaeb-ce3b-4ac4-972a-148410d784a0 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Received unexpected event network-vif-plugged-8069f888-3b93-4c26-9ba8-6eb3ba6b053c for instance with vm_state active and task_state deleting.
Aug 14 15:01:43 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:01:43 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Took 0.46 seconds to deallocate network for instance.
Aug 14 15:01:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:44 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:01:44 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:01:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:44 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Deleted allocations for instance 244d32a6-c532-4e7e-84dd-b747a7a05c4b
Aug 14 15:01:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-86c8131d-fd2f-4395-99f1-9b4bd2b0d965 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "244d32a6-c532-4e7e-84dd-b747a7a05c4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.889s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-f775bdf1-7c76-47d4-ac83-b6447e168342 req-3250213e-b9aa-4c09-843d-98304d590392 service nova] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Received event network-vif-deleted-8069f888-3b93-4c26-9ba8-6eb3ba6b053c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:01:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZXLbYhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:01:51 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:01:51 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:01:51 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ed6f82-524d-4ca6-856b-30ae882e05d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:01:51 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc76c0a-488b-4e91-ac2c-cf85cc0e9a8e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2] added
Aug 14 15:01:51 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[258bb8a5-18df-442c-8599-556585501a06]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cccf40-5ad2-419d-813e-74577bad6fd2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pZXLbYhN {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pZXLbYhN" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4826eb-b824-4c47-895b-40f8aaacca8b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pZXLbYhN'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9778dec6-0688-41df-975c-a82797fb02eb]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[82faf101-dd98-4b85-af9b-eeda5cf960e6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:51 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:51 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:01:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[99eb31bd-0f67-4a69-b087-06df39439e48]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2, portal: 172.16.0.220,3260]
Aug 14 15:01:52 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2, portal: 172.16.0.220,3260] successful.
Aug 14 15:01:52 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025297.024451, 94250a67-88b2-48ac-88ad-8b298cf66692 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:01:52 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] VM Stopped (Lifecycle Event)
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-984cc6f6-8efe-4f80-8eda-07c2bb195244 None None] [instance: 94250a67-88b2-48ac-88ad-8b298cf66692] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0911e66-480f-4639-9205-aa5ed7922650]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[581d5c95-aa9d-41e3-9d9e-2c2aabf29473]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:52 user nova-compute[73254]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 (non-flash)
Aug 14 15:01:52 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:52 user nova-compute[73254]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 (non-flash)
Aug 14 15:01:52 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ac19b6-c2b6-411c-9b4e-78aaf2247ffe]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:01:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZXLbYhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:01:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:01:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23464363434646662', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:01:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464363434646662', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:01:53 user nova-compute[73254]: DEBUG nova.objects.instance [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'flavor' on Instance uuid 4b878d88-e5f3-41b9-a399-c2da1806e1fc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:01:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:01:53 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:01:53 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:01:53 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:01:53 user nova-compute[73254]:   <serial>44215dd6-1d41-4511-8adf-9a349ecf55a2</serial>
Aug 14 15:01:53 user nova-compute[73254]: </disk>
Aug 14 15:01:53 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:01:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:01:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:01:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] No VIF found with MAC fa:16:3e:cb:7e:c3, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:01:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-09b28357-09ae-4aba-91c9-bcf5ad7dc1c0 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.671s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:01:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:55 user nova-compute[73254]: INFO nova.compute.manager [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Detaching volume 44215dd6-1d41-4511-8adf-9a349ecf55a2
Aug 14 15:01:55 user nova-compute[73254]: INFO nova.virt.block_device [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Attempting to driver detach volume 44215dd6-1d41-4511-8adf-9a349ecf55a2 from mountpoint /dev/vdb
Aug 14 15:01:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Attempting to detach device vdb from instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:01:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:01:55 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:01:55 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:01:55 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:01:55 user nova-compute[73254]:   <serial>44215dd6-1d41-4511-8adf-9a349ecf55a2</serial>
Aug 14 15:01:55 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:01:55 user nova-compute[73254]: </disk>
Aug 14 15:01:55 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:01:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Successfully detached device vdb from instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc from the persistent domain config.
Aug 14 15:01:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:01:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:01:55 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:01:55 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:01:55 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:01:55 user nova-compute[73254]:   <serial>44215dd6-1d41-4511-8adf-9a349ecf55a2</serial>
Aug 14 15:01:55 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:01:55 user nova-compute[73254]: </disk>
Aug 14 15:01:55 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025316.3795223, 4b878d88-e5f3-41b9-a399-c2da1806e1fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:01:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Successfully detached device vdb from instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc from the live domain config.
Aug 14 15:01:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pZXLbYhN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:01:56 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71ecab6-ce71-4612-84f5-736f9e3806c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[871aecb6-534e-4105-b9b1-0adab32b7406]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:56 user nova-compute[73254]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 (non-flash)
Aug 14 15:01:56 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:01:56 user nova-compute[73254]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 (non-flash)
Aug 14 15:01:56 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648691990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[caead08d-7147-423e-abba-d2cb8951af07]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4217f4b-0fed-4e06-a623-fa84cedcdb42]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7081138-2c05-4a34-a50a-27cbf820440d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8713fa0c-66f4-42d5-82e7-d82018270e6b]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.058s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2d897e-6ac8-4d3c-984d-6336af585bdb]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a8eada-0802-47a4-9f69-b56f50984b71]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2, portal: 172.16.0.220,3260]
Aug 14 15:01:56 user nova-compute[73254]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2, portal: 172.16.0.220,3260] successful.
Aug 14 15:01:56 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44215dd6-1d41-4511-8adf-9a349ecf55a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6615bea-7838-4845-933d-5a5a62c1a551]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] <== disconnect_volume: return (337ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:01:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG nova.objects.instance [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'flavor' on Instance uuid 4b878d88-e5f3-41b9-a399-c2da1806e1fc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-136a5ba7-c00e-4449-89a3-e8e434b72d61 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.880s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025303.2245224, 244d32a6-c532-4e7e-84dd-b747a7a05c4b => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:01:58 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] VM Stopped (Lifecycle Event)
Aug 14 15:01:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eb25030b-178f-4877-874c-0489a260305d None None] [instance: 244d32a6-c532-4e7e-84dd-b747a7a05c4b] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:01:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'flavor' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:00 user nova-compute[73254]: INFO nova.compute.manager [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Attaching volume 79a4d0f2-5a42-41bd-bbbd-4e3eea10947b to /dev/vdb
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG os_brick.utils [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a64e81-ed39-4f52-816b-0be4fbe49c0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b9e528-5282-4d6e-93e3-d8c0d501bc7f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a28e4e-1039-4543-8726-38bdeb277da3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c4c618-aaa1-4ab5-94a0-45ea44a82f55]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:00 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4e4530-f81f-4fb8-8561-e7cd6a01be11]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG os_brick.utils [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating existing volume attachment record: dcb1c3a2-a419-49b1-9070-ac5608034602 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:01 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:02:01 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7341MB free_disk=25.525829315185547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 16996b6c-6d6e-4b51-88f3-0ca024e95639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0110dafc-b336-45bd-aade-0eb9ba632a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance da915cb7-8ab5-4c65-928f-70e94811dd4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance fe35bcec-a10d-4554-8cd7-1a9d1a72f484 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 2d7ac783-716a-4c23-9466-fa7d5eae73a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0674641b-1cd6-43ba-9970-f3cdd88a2b59 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 73803036-4ad2-42b7-8d7e-40d2a97880fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:02:01 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:02:02 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:02:02 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:02:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:02:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:03 user nova-compute[73254]: INFO nova.compute.manager [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Unshelving
Aug 14 15:02:03 user nova-compute[73254]: INFO nova.virt.block_device [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Booting with volume f484e8c7-e4b6-4d37-820f-7f100c848c9a at /dev/vdc
Aug 14 15:02:03 user nova-compute[73254]: DEBUG os_brick.utils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8b835b-9634-4485-b38e-8d64c15ccd5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b578e51-61db-4eda-a160-3e6216b0ef4e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ada5bcf-404e-4d2c-bc53-71ed3df8f64e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44208ce-cc89-44c1-9178-6e0975d16a35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:03 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:02:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[90924557-5d46-4fd9-941a-5e5338f71fdf]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG os_brick.utils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:03 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating existing volume attachment record: 238167d9-50e3-4b9e-8820-da611d92160e {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Updating instance_info_cache with network_info: [{"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-da915cb7-8ab5-4c65-928f-70e94811dd4e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:02:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:10 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:10 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:10 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f767e8-049a-4700-911f-5dab2b0fec66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:02:10 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b613f842-9491-43d8-8405-7443a092febd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b] added
Aug 14 15:02:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a064792-2496-48c1-97bc-cf172ea72641]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[245ab514-4825-4487-b796-0ed20394f999]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IjvdWDfU {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IjvdWDfU" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d71a26-63f2-4db8-b58a-39bd3bd0f413]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IjvdWDfU'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdfb394-7c78-4e2c-84f6-513bfc159dc2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbd2115-4a9e-4ad8-8b3e-da2ca2b3c81a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6e548b-29bd-4aa6-a126-e1738ca75fa8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]
Aug 14 15:02:10 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.
Aug 14 15:02:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9290cf0e-792c-4bf9-ad30-4001ec1760ec]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e03069-b205-4d85-816a-8c093aa85820]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:10 user nova-compute[73254]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:10 user nova-compute[73254]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dfa287-a423-4272-91cb-318a754e57a5]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:10 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26335323934656337', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335323934656337', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'flavor' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:02:11 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:02:11 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:02:11 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:02:11 user nova-compute[73254]:   <serial>79a4d0f2-5a42-41bd-bbbd-4e3eea10947b</serial>
Aug 14 15:02:11 user nova-compute[73254]: </disk>
Aug 14 15:02:11 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:02:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] No VIF found with MAC fa:16:3e:02:af:58, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:02:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4ad43078-297e-4baa-b751-bbd54ab69680 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.673s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:13 user nova-compute[73254]: DEBUG nova.objects.instance [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'pci_requests' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:13 user nova-compute[73254]: DEBUG nova.objects.instance [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'numa_topology' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:02:13 user nova-compute[73254]: INFO nova.compute.claims [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Claim successful on node user
Aug 14 15:02:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Stashing vm_state: active {{(pid=73254) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'pci_requests' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:02:14 user nova-compute[73254]: INFO nova.compute.claims [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Claim successful on node user
Aug 14 15:02:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'resources' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'pci_devices' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:14 user nova-compute[73254]: INFO nova.network.neutron [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating port d61382b4-4de4-4c87-af8d-1e23129c8d9c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 15:02:14 user nova-compute[73254]: INFO nova.compute.resource_tracker [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating resource usage from migration 8c8f7735-76f7-4cdc-afeb-42761e7e9014
Aug 14 15:02:14 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.459s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:14 user nova-compute[73254]: INFO nova.compute.manager [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Migrating
Aug 14 15:02:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:14 user nova-compute[73254]: INFO nova.compute.rpcapi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 14 15:02:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquired lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquired lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-8761f228-0d1f-4202-966b-ce9a6a862eef req-cb262ce4-dded-452e-907b-47f621f96d09 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-changed-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-8761f228-0d1f-4202-966b-ce9a6a862eef req-cb262ce4-dded-452e-907b-47f621f96d09 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Refreshing instance network info cache due to event network-changed-d61382b4-4de4-4c87-af8d-1e23129c8d9c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8761f228-0d1f-4202-966b-ce9a6a862eef req-cb262ce4-dded-452e-907b-47f621f96d09 service nova] Acquiring lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance_info_cache with network_info: [{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Releasing lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Starting migrate_disk_and_power_off {{(pid=73254) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating instance_info_cache with network_info: [{"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Releasing lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:02:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Creating image(s)
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "/opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "/opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "/opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.061s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'trusted_certs' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8761f228-0d1f-4202-966b-ce9a6a862eef req-cb262ce4-dded-452e-907b-47f621f96d09 service nova] Acquired lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG nova.network.neutron [req-8761f228-0d1f-4202-966b-ce9a6a862eef req-cb262ce4-dded-452e-907b-47f621f96d09 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Refreshing network info cache for port d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "9910d2a89161e43d5b8d2e3b9995b172b8c78518" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "9910d2a89161e43d5b8d2e3b9995b172b8c78518" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518.part --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance destroyed successfully.
Aug 14 15:02:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1755851336',display_name='tempest-ServerActionsTestOtherB-server-1755851336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1755851336',id=2,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpJqshf7dgOYCNb3XdGQKDGpgxinwrIHq7RhTsMWSm+s6EZD5PqStn0mS7XZys0yosnUZjjjacxB+uA7VCgltNQhd/8n8Kmf9j/njpDibTqPOQpZxcFfHs+Tu7LtgV0vQ==',key_name='tempest-keypair-50791975',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7efec9b494b419d88e619898e61108c',ramdisk_id='',reservation_id='r-raqid4hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-872428687',owner_user_name='tempest-ServerActionsTestOtherB-872428687-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:02:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02901b088217434eb2a8a4f914ac3e18',uuid=0110dafc-b336-45bd-aade-0eb9ba632a05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1966471165-network", "vif_mac": "fa:16:3e:02:af:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converting VIF {"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1966471165-network", "vif_mac": "fa:16:3e:02:af:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG os_vif [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ce5ac2e-ae, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:02:16 user nova-compute[73254]: INFO os_vif [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae')
Aug 14 15:02:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:16 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c4a40-3ede-4eec-b6db-594eca9a18bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe4767d-25ed-4b3b-a8d2-5630eb1eff01]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:16 user nova-compute[73254]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:16 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:16 user nova-compute[73254]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:16 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648691360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518.part --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG nova.virt.images [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] 1f049d37-6fa4-4642-995e-602f38910e77 was qcow2, converting to raw {{(pid=73254) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518.part /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518.converted {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b84b137-2acd-4208-a7cb-fdd530286784]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a857cb-c4ea-4531-b3ea-e6a02814c060]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef36e70-50fc-4bc7-ad6a-2830fd15a24d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a945dcb5-2056-4a9d-b7e6-1dde33f1e147]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518.part /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518.converted" returned: 0 in 0.185s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518.converted --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.119s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bedb567-bb58-46af-a47d-fcb3d2eba84f]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-8761f228-0d1f-4202-966b-ce9a6a862eef req-cb262ce4-dded-452e-907b-47f621f96d09 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updated VIF entry in instance network info cache for port d61382b4-4de4-4c87-af8d-1e23129c8d9c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-8761f228-0d1f-4202-966b-ce9a6a862eef req-cb262ce4-dded-452e-907b-47f621f96d09 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating instance_info_cache with network_info: [{"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8761f228-0d1f-4202-966b-ce9a6a862eef req-cb262ce4-dded-452e-907b-47f621f96d09 service nova] Releasing lock "refresh_cache-01e4cd7e-3fd9-47fe-870e-31fcd457e263" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-unplugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-unplugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:02:17 user nova-compute[73254]: WARNING nova.compute.manager [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-unplugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state active and task_state resize_migrating.
Aug 14 15:02:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:02:17 user nova-compute[73254]: WARNING nova.compute.manager [req-884eb6cb-f7f1-48a4-9c12-1f6740d0ccc7 req-fe6cabb5-461d-4a48-8532-3d144a751239 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state active and task_state resize_migrating.
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518.converted --force-share --output=json" returned: 0 in 0.241s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "9910d2a89161e43d5b8d2e3b9995b172b8c78518" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.552s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --logout" returned: 0 in 0.164s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88aa6f4-7a10-4f1d-8a53-2082e4ba00ce]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]
Aug 14 15:02:17 user nova-compute[73254]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.
Aug 14 15:02:17 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2a8903-0251-4cae-b600-a2852b617984]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.614s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] <== disconnect_volume: return (616ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518 --force-share --output=json" returned: 0 in 0.217s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "9910d2a89161e43d5b8d2e3b9995b172b8c78518" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "9910d2a89161e43d5b8d2e3b9995b172b8c78518" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518 --force-share --output=json" returned: 0 in 0.201s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518,backing_fmt=raw /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518,backing_fmt=raw /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk 1073741824" returned: 0 in 0.050s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "9910d2a89161e43d5b8d2e3b9995b172b8c78518" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:02:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05_resize/disk /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518 --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG nova.objects.instance [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'migration_context' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Rebasing disk image.
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc -F raw /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'flavor' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "cp -r /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05_resize/disk /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk" returned: 0 in 0.423s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05_resize/disk.info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk.info {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "cp -r /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05_resize/disk.info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk.info" returned: 0 in 0.040s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.097s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:18 user nova-compute[73254]: INFO nova.compute.manager [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Attaching volume 5e02d324-2e59-4152-a018-d6f65bbd0932 to /dev/vdb
Aug 14 15:02:18 user nova-compute[73254]: DEBUG os_brick.utils [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.037s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eb3873-129c-413e-971c-8f58a10fb083]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf813b6-78e4-46b5-b0dc-32248bc7cc13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2166e0fd-ed2a-489d-b812-a55bb8bda586]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[50958ad1-df87-458c-9ccd-8238ded87493]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:18 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:02:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[234b871a-08c8-427a-82a6-08cfa582a4cd]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG os_brick.utils [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:18 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updating existing volume attachment record: 47cd7ddc-e6d1-4b35-b2ec-a2f931e9ddf3 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:02:19 user nova-compute[73254]: DEBUG nova.network.neutron [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Port 5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 binding to destination host user is already ACTIVE {{(pid=73254) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 15:02:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquired lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:19 user nova-compute[73254]: DEBUG nova.network.neutron [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc -F raw /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk" returned: 0 in 2.394s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Ensure instance console log exists: /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Start _get_guest_xml network_info=[{"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='2a2c4a43249cb6cdad4a0c62d2464687',container_format='bare',created_at=2023-08-14T15:00:11Z,direct_url=<?>,disk_format='qcow2',id=1f049d37-6fa4-4642-995e-602f38910e77,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-996986071-shelved',owner='3ac5a724189545548484fba6d4e0c842',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T15:00:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '238167d9-50e3-4b9e-8820-da611d92160e', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWLNZjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '01e4cd7e-3fd9-47fe-870e-31fcd457e263', 'attached_at': '', 'detached_at': '', 'volume_id': 'f484e8c7-e4b6-4d37-820f-7f100c848c9a', 'serial': 'f484e8c7-e4b6-4d37-820f-7f100c848c9a'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:02:20 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:02:20 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='2a2c4a43249cb6cdad4a0c62d2464687',container_format='bare',created_at=2023-08-14T15:00:11Z,direct_url=<?>,disk_format='qcow2',id=1f049d37-6fa4-4642-995e-602f38910e77,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-996986071-shelved',owner='3ac5a724189545548484fba6d4e0c842',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T15:00:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.objects.instance [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWLNZjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:20 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:20 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:20 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:02:20 user nova-compute[73254]: DEBUG nova.network.neutron [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance_info_cache with network_info: [{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Releasing lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260" returned: 21 in 0.054s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c481dc-e2ea-4f4c-a890-aefd4e90b183]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:02:20 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a8de80-b73e-4f54-b378-cc16deb8449e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a] added
Aug 14 15:02:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[336d8593-528f-489f-8958-b488b24077ab]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab2c1c5-51ce-4c50-8500-c18f8a03f51f]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVWLNZjK {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FVWLNZjK" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c43c36-f6eb-4905-b7e2-eee68ccf554b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FVWLNZjK'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0257f5-4fee-4095-9651-8fc3f47664d0]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.utils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e98c31-e063-4443-98f5-d54a2d22968d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[516a4dad-2640-442c-9f8c-dfda5aa124f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef5224a-da2b-4d82-a9e1-1389f739498f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c555e0-f008-4917-b93e-db231dab3189]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[588cdaa9-d5cd-4e0d-88a4-7724c59ecbb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c166757-b8bd-4c23-bdcf-75a20781fe75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a, portal: 172.16.0.220,3260]
Aug 14 15:02:21 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a, portal: 172.16.0.220,3260] successful.
Aug 14 15:02:21 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:21 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cdec22-c468-462c-9c5f-9147aa144290]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.utils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb0fc58-602b-4a50-ac7f-356c06ea86c1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a4ced0-7adc-47a7-9de8-b943c550eaf3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:21 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:21 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:21 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:21 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b26df18-e4f9-452b-ad03-cd848457723f]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWLNZjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23536356366623936', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536356366623936', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T14:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-996986071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-996986071',id=3,image_ref='1f049d37-6fa4-4642-995e-602f38910e77',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-23196029',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-72pyg0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member',shelved_at='2023-08-14T15:00:15.922422',shelved_host='user',shelved_image_id='1f049d37-6fa4-4642-995e-602f38910e77'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01e4cd7e-3fd9-47fe-870e-31fcd457e263,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.objects.instance [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'pci_devices' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:02:22 user nova-compute[73254]:   <uuid>01e4cd7e-3fd9-47fe-870e-31fcd457e263</uuid>
Aug 14 15:02:22 user nova-compute[73254]:   <name>instance-00000003</name>
Aug 14 15:02:22 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:02:22 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:02:22 user nova-compute[73254]:   <metadata>
Aug 14 15:02:22 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:02:22 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:02:22 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-996986071</nova:name>
Aug 14 15:02:22 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:02:20</nova:creationTime>
Aug 14 15:02:22 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:02:22 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:02:22 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:02:22 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:02:22 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:02:22 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:02:22 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:02:22 user nova-compute[73254]:       <nova:owner>
Aug 14 15:02:22 user nova-compute[73254]:         <nova:user uuid="abc1e49d76ae4690b8ab6b1dd5ec5eae">tempest-AttachVolumeShelveTestJSON-960640486-project-member</nova:user>
Aug 14 15:02:22 user nova-compute[73254]:         <nova:project uuid="3ac5a724189545548484fba6d4e0c842">tempest-AttachVolumeShelveTestJSON-960640486</nova:project>
Aug 14 15:02:22 user nova-compute[73254]:       </nova:owner>
Aug 14 15:02:22 user nova-compute[73254]:       <nova:root type="image" uuid="1f049d37-6fa4-4642-995e-602f38910e77"/>
Aug 14 15:02:22 user nova-compute[73254]:       <nova:ports>
Aug 14 15:02:22 user nova-compute[73254]:         <nova:port uuid="d61382b4-4de4-4c87-af8d-1e23129c8d9c">
Aug 14 15:02:22 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 15:02:22 user nova-compute[73254]:         </nova:port>
Aug 14 15:02:22 user nova-compute[73254]:       </nova:ports>
Aug 14 15:02:22 user nova-compute[73254]:     </nova:instance>
Aug 14 15:02:22 user nova-compute[73254]:   </metadata>
Aug 14 15:02:22 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:02:22 user nova-compute[73254]:     <system>
Aug 14 15:02:22 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:02:22 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:02:22 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:02:22 user nova-compute[73254]:       <entry name="serial">01e4cd7e-3fd9-47fe-870e-31fcd457e263</entry>
Aug 14 15:02:22 user nova-compute[73254]:       <entry name="uuid">01e4cd7e-3fd9-47fe-870e-31fcd457e263</entry>
Aug 14 15:02:22 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:02:22 user nova-compute[73254]:     </system>
Aug 14 15:02:22 user nova-compute[73254]:   </sysinfo>
Aug 14 15:02:22 user nova-compute[73254]:   <os>
Aug 14 15:02:22 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:02:22 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:02:22 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:02:22 user nova-compute[73254]:   </os>
Aug 14 15:02:22 user nova-compute[73254]:   <features>
Aug 14 15:02:22 user nova-compute[73254]:     <acpi/>
Aug 14 15:02:22 user nova-compute[73254]:     <apic/>
Aug 14 15:02:22 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:02:22 user nova-compute[73254]:   </features>
Aug 14 15:02:22 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:02:22 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:02:22 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:02:22 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:02:22 user nova-compute[73254]:   </clock>
Aug 14 15:02:22 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:02:22 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:02:22 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:02:22 user nova-compute[73254]:   </cpu>
Aug 14 15:02:22 user nova-compute[73254]:   <devices>
Aug 14 15:02:22 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:02:22 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:02:22 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk"/>
Aug 14 15:02:22 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:02:22 user nova-compute[73254]:     </disk>
Aug 14 15:02:22 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:02:22 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:02:22 user nova-compute[73254]:       <source dev="/dev/sdc"/>
Aug 14 15:02:22 user nova-compute[73254]:       <target dev="vdc" bus="virtio"/>
Aug 14 15:02:22 user nova-compute[73254]:       <serial>f484e8c7-e4b6-4d37-820f-7f100c848c9a</serial>
Aug 14 15:02:22 user nova-compute[73254]:     </disk>
Aug 14 15:02:22 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:02:22 user nova-compute[73254]:       <mac address="fa:16:3e:8d:e3:3d"/>
Aug 14 15:02:22 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:02:22 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:02:22 user nova-compute[73254]:       <target dev="tapd61382b4-4d"/>
Aug 14 15:02:22 user nova-compute[73254]:     </interface>
Aug 14 15:02:22 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:02:22 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/console.log" append="off"/>
Aug 14 15:02:22 user nova-compute[73254]:     </serial>
Aug 14 15:02:22 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:02:22 user nova-compute[73254]:     <video>
Aug 14 15:02:22 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:02:22 user nova-compute[73254]:     </video>
Aug 14 15:02:22 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:02:22 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:02:22 user nova-compute[73254]:     </rng>
Aug 14 15:02:22 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:02:22 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:02:22 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:02:22 user nova-compute[73254]:     </memballoon>
Aug 14 15:02:22 user nova-compute[73254]:   </devices>
Aug 14 15:02:22 user nova-compute[73254]: </domain>
Aug 14 15:02:22 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T14:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-996986071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-996986071',id=3,image_ref='1f049d37-6fa4-4642-995e-602f38910e77',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-23196029',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-72pyg0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member',shelved_at='2023-08-14T15:00:15.922422',shelved_host='user',shelved_image_id='1f049d37-6fa4-4642-995e-602f38910e77'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01e4cd7e-3fd9-47fe-870e-31fcd457e263,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG os_vif [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd61382b4-4d, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd61382b4-4d, col_values=(('external_ids', {'iface-id': 'd61382b4-4de4-4c87-af8d-1e23129c8d9c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:e3:3d', 'vm-uuid': '01e4cd7e-3fd9-47fe-870e-31fcd457e263'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:22 user nova-compute[73254]: INFO os_vif [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d')
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:02:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] No VIF found with MAC fa:16:3e:8d:e3:3d, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:02:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-413c610b-b1ad-40d4-a0f3-b9b361c80562 req-a0eb367a-c93f-4499-b3d8-22e573a628d6 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-413c610b-b1ad-40d4-a0f3-b9b361c80562 req-a0eb367a-c93f-4499-b3d8-22e573a628d6 service nova] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-413c610b-b1ad-40d4-a0f3-b9b361c80562 req-a0eb367a-c93f-4499-b3d8-22e573a628d6 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-413c610b-b1ad-40d4-a0f3-b9b361c80562 req-a0eb367a-c93f-4499-b3d8-22e573a628d6 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-413c610b-b1ad-40d4-a0f3-b9b361c80562 req-a0eb367a-c93f-4499-b3d8-22e573a628d6 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] No waiting events found dispatching network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:02:24 user nova-compute[73254]: WARNING nova.compute.manager [req-413c610b-b1ad-40d4-a0f3-b9b361c80562 req-a0eb367a-c93f-4499-b3d8-22e573a628d6 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received unexpected event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 15:02:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025346.2508361, 01e4cd7e-3fd9-47fe-870e-31fcd457e263 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:02:26 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] VM Resumed (Lifecycle Event)
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.compute.manager [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:02:26 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Instance spawned successfully.
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-6b1bf2db-600b-4d7f-aa9a-90c09d2e38ca req-24e9173f-2065-4491-a68a-b5b874b2e8a3 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6b1bf2db-600b-4d7f-aa9a-90c09d2e38ca req-24e9173f-2065-4491-a68a-b5b874b2e8a3 service nova] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6b1bf2db-600b-4d7f-aa9a-90c09d2e38ca req-24e9173f-2065-4491-a68a-b5b874b2e8a3 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6b1bf2db-600b-4d7f-aa9a-90c09d2e38ca req-24e9173f-2065-4491-a68a-b5b874b2e8a3 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-6b1bf2db-600b-4d7f-aa9a-90c09d2e38ca req-24e9173f-2065-4491-a68a-b5b874b2e8a3 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] No waiting events found dispatching network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:02:26 user nova-compute[73254]: WARNING nova.compute.manager [req-6b1bf2db-600b-4d7f-aa9a-90c09d2e38ca req-24e9173f-2065-4491-a68a-b5b874b2e8a3 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received unexpected event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:02:26 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025346.2521222, 01e4cd7e-3fd9-47fe-870e-31fcd457e263 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:02:26 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] VM Started (Lifecycle Event)
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:02:26 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:02:26 user nova-compute[73254]: DEBUG nova.compute.manager [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:02:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763dcd0c-eac7-4c10-aa90-2476d8502718 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.016s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdVQgqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:28 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:28 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:28 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260" returned: 21 in 0.050s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7072e40-0b4b-4b21-b587-d0a01cb00e85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:02:28 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2316ea14-d903-4c18-8554-4902c3ce0f99]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932] added
Aug 14 15:02:28 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d286e2-d092-4e5c-ba55-fcc104bba52f]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bcd792-d4ec-4944-98f6-6f00a170b76e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzdVQgqw {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzdVQgqw" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a510a9-cbc1-4bb6-a531-fcd7b25e3a01]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jzdVQgqw'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b06523-c9ff-4983-9ce0-ce50e66fbe9c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d535e5b0-9512-4911-82ec-9c7e3a24392f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:28 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:28 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:28 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:28 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f517935-08e2-49b4-9991-1b288857635b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260]
Aug 14 15:02:28 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260] successful.
Aug 14 15:02:28 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d9aac2-eb6a-4b24-a170-68657673d3c3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d3db4f-1f8d-469e-8982-2e60a06d133d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:29 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:29 user nova-compute[73254]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:29 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:29 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:29 user nova-compute[73254]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:29 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7518ac54-fa95-4500-a016-91144c31a568]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:02:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdVQgqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:02:30 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:30 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23939373232303230', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939373232303230', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:02:30 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'flavor' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:02:30 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:02:30 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:02:30 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:02:30 user nova-compute[73254]:   <serial>5e02d324-2e59-4152-a018-d6f65bbd0932</serial>
Aug 14 15:02:30 user nova-compute[73254]: </disk>
Aug 14 15:02:30 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:02:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:02:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:02:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] No VIF found with MAC fa:16:3e:53:33:f6, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:02:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d93b76d-22ee-44e6-b145-d7ae00065ef0 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.089s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Starting finish_migration {{(pid=73254) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance directory exists: not creating {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 15:02:31 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Creating image(s)
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.258s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk. size=21474836480 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk 21474836480 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025336.3891284, 0110dafc-b336-45bd-aade-0eb9ba632a05 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:02:31 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] VM Stopped (Lifecycle Event)
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk 21474836480" returned: 0 in 0.053s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-83c5fa9c-6ae5-4d76-9295-b9b4f44e988d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Ensure instance console log exists: /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Start _get_guest_xml network_info=[{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1966471165-network", "vif_mac": "fa:16:3e:02:af:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c78cddbb-8435-421d-b46e-546b737cc733', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0110dafc-b336-45bd-aade-0eb9ba632a05', 'attached_at': '2023-08-14T15:02:31.000000', 'detached_at': '', 'volume_id': '79a4d0f2-5a42-41bd-bbbd-4e3eea10947b', 'serial': '79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-83c5fa9c-6ae5-4d76-9295-b9b4f44e988d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:02:31 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:02:31 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:31 user nova-compute[73254]: INFO nova.compute.manager [None req-83c5fa9c-6ae5-4d76-9295-b9b4f44e988d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 15:02:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:31 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:31 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:31 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f712df3-966c-407b-924d-7cd44ec8727c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:02:31 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c521b681-d268-4e1e-85b6-d2cb37302487]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b] added
Aug 14 15:02:32 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9df4c7e-9710-4892-916f-c93877cf30df]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf5d00-0242-4679-9139-b84aec0f1ec5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IjvdWDfU {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IjvdWDfU" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1435cbe9-2d67-41bc-8294-fba1f7ced848]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IjvdWDfU'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[37310602-3238-4c19-b6e6-bb9dc8932005]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b71092a-075c-4926-8f01-b98fa8ac9a79]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:32 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:32 user nova-compute[73254]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:32 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:32 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:32 user nova-compute[73254]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:32 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d780eb6f-43ca-4262-add3-4dba66f30a3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]
Aug 14 15:02:32 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.
Aug 14 15:02:32 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c1ef5a-97be-4622-9f58-f5c966369739]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8d06c8-67d6-44c0-a68b-0ab967d5107f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:32 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:32 user nova-compute[73254]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:32 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:32 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:32 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:32 user nova-compute[73254]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:32 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:32 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d876c0b-7bd0-4ca1-816c-8fb554948967]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:02:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26335323934656337', 'path': '/dev/sde'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335323934656337', 'path': '/dev/sde'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1755851336',display_name='tempest-ServerActionsTestOtherB-server-1755851336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1755851336',id=2,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpJqshf7dgOYCNb3XdGQKDGpgxinwrIHq7RhTsMWSm+s6EZD5PqStn0mS7XZys0yosnUZjjjacxB+uA7VCgltNQhd/8n8Kmf9j/njpDibTqPOQpZxcFfHs+Tu7LtgV0vQ==',key_name='tempest-keypair-50791975',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7efec9b494b419d88e619898e61108c',ramdisk_id='',reservation_id='r-raqid4hj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-872428687',owner_user_name='tempest-ServerActionsTestOtherB-872428687-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02901b088217434eb2a8a4f914ac3e18',uuid=0110dafc-b336-45bd-aade-0eb9ba632a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1966471165-network", "vif_mac": "fa:16:3e:02:af:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converting VIF {"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1966471165-network", "vif_mac": "fa:16:3e:02:af:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:02:33 user nova-compute[73254]:   <uuid>0110dafc-b336-45bd-aade-0eb9ba632a05</uuid>
Aug 14 15:02:33 user nova-compute[73254]:   <name>instance-00000002</name>
Aug 14 15:02:33 user nova-compute[73254]:   <memory>2097152</memory>
Aug 14 15:02:33 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:02:33 user nova-compute[73254]:   <metadata>
Aug 14 15:02:33 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:02:33 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:02:33 user nova-compute[73254]:       <nova:name>tempest-ServerActionsTestOtherB-server-1755851336</nova:name>
Aug 14 15:02:33 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:02:31</nova:creationTime>
Aug 14 15:02:33 user nova-compute[73254]:       <nova:flavor name="m1.small">
Aug 14 15:02:33 user nova-compute[73254]:         <nova:memory>2048</nova:memory>
Aug 14 15:02:33 user nova-compute[73254]:         <nova:disk>20</nova:disk>
Aug 14 15:02:33 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:02:33 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:02:33 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:02:33 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:02:33 user nova-compute[73254]:       <nova:owner>
Aug 14 15:02:33 user nova-compute[73254]:         <nova:user uuid="02901b088217434eb2a8a4f914ac3e18">tempest-ServerActionsTestOtherB-872428687-project-member</nova:user>
Aug 14 15:02:33 user nova-compute[73254]:         <nova:project uuid="b7efec9b494b419d88e619898e61108c">tempest-ServerActionsTestOtherB-872428687</nova:project>
Aug 14 15:02:33 user nova-compute[73254]:       </nova:owner>
Aug 14 15:02:33 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:02:33 user nova-compute[73254]:       <nova:ports>
Aug 14 15:02:33 user nova-compute[73254]:         <nova:port uuid="5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3">
Aug 14 15:02:33 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 15:02:33 user nova-compute[73254]:         </nova:port>
Aug 14 15:02:33 user nova-compute[73254]:       </nova:ports>
Aug 14 15:02:33 user nova-compute[73254]:     </nova:instance>
Aug 14 15:02:33 user nova-compute[73254]:   </metadata>
Aug 14 15:02:33 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:02:33 user nova-compute[73254]:     <system>
Aug 14 15:02:33 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:02:33 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:02:33 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:02:33 user nova-compute[73254]:       <entry name="serial">0110dafc-b336-45bd-aade-0eb9ba632a05</entry>
Aug 14 15:02:33 user nova-compute[73254]:       <entry name="uuid">0110dafc-b336-45bd-aade-0eb9ba632a05</entry>
Aug 14 15:02:33 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:02:33 user nova-compute[73254]:     </system>
Aug 14 15:02:33 user nova-compute[73254]:   </sysinfo>
Aug 14 15:02:33 user nova-compute[73254]:   <os>
Aug 14 15:02:33 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:02:33 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:02:33 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:02:33 user nova-compute[73254]:   </os>
Aug 14 15:02:33 user nova-compute[73254]:   <features>
Aug 14 15:02:33 user nova-compute[73254]:     <acpi/>
Aug 14 15:02:33 user nova-compute[73254]:     <apic/>
Aug 14 15:02:33 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:02:33 user nova-compute[73254]:   </features>
Aug 14 15:02:33 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:02:33 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:02:33 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:02:33 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:02:33 user nova-compute[73254]:   </clock>
Aug 14 15:02:33 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:02:33 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:02:33 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:02:33 user nova-compute[73254]:   </cpu>
Aug 14 15:02:33 user nova-compute[73254]:   <devices>
Aug 14 15:02:33 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:02:33 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:02:33 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk"/>
Aug 14 15:02:33 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:02:33 user nova-compute[73254]:     </disk>
Aug 14 15:02:33 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:02:33 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:02:33 user nova-compute[73254]:       <source dev="/dev/sde"/>
Aug 14 15:02:33 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:02:33 user nova-compute[73254]:       <serial>79a4d0f2-5a42-41bd-bbbd-4e3eea10947b</serial>
Aug 14 15:02:33 user nova-compute[73254]:     </disk>
Aug 14 15:02:33 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:02:33 user nova-compute[73254]:       <mac address="fa:16:3e:02:af:58"/>
Aug 14 15:02:33 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:02:33 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:02:33 user nova-compute[73254]:       <target dev="tap5ce5ac2e-ae"/>
Aug 14 15:02:33 user nova-compute[73254]:     </interface>
Aug 14 15:02:33 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:02:33 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/console.log" append="off"/>
Aug 14 15:02:33 user nova-compute[73254]:     </serial>
Aug 14 15:02:33 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:02:33 user nova-compute[73254]:     <video>
Aug 14 15:02:33 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:02:33 user nova-compute[73254]:     </video>
Aug 14 15:02:33 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:02:33 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:02:33 user nova-compute[73254]:     </rng>
Aug 14 15:02:33 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:02:33 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:02:33 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:02:33 user nova-compute[73254]:     </memballoon>
Aug 14 15:02:33 user nova-compute[73254]:   </devices>
Aug 14 15:02:33 user nova-compute[73254]: </domain>
Aug 14 15:02:33 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1755851336',display_name='tempest-ServerActionsTestOtherB-server-1755851336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1755851336',id=2,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpJqshf7dgOYCNb3XdGQKDGpgxinwrIHq7RhTsMWSm+s6EZD5PqStn0mS7XZys0yosnUZjjjacxB+uA7VCgltNQhd/8n8Kmf9j/njpDibTqPOQpZxcFfHs+Tu7LtgV0vQ==',key_name='tempest-keypair-50791975',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7efec9b494b419d88e619898e61108c',ramdisk_id='',reservation_id='r-raqid4hj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-872428687',owner_user_name='tempest-ServerActionsTestOtherB-872428687-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02901b088217434eb2a8a4f914ac3e18',uuid=0110dafc-b336-45bd-aade-0eb9ba632a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1966471165-network", "vif_mac": "fa:16:3e:02:af:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converting VIF {"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1966471165-network", "vif_mac": "fa:16:3e:02:af:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG os_vif [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ce5ac2e-ae, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ce5ac2e-ae, col_values=(('external_ids', {'iface-id': '5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:af:58', 'vm-uuid': '0110dafc-b336-45bd-aade-0eb9ba632a05'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:33 user nova-compute[73254]: INFO os_vif [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae')
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:02:33 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] No VIF found with MAC fa:16:3e:02:af:58, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:02:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-98fb07f0-559f-42f7-b310-328a160234f7 req-22a762e4-d7f3-42c9-a183-40069f1732a1 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-98fb07f0-559f-42f7-b310-328a160234f7 req-22a762e4-d7f3-42c9-a183-40069f1732a1 service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-98fb07f0-559f-42f7-b310-328a160234f7 req-22a762e4-d7f3-42c9-a183-40069f1732a1 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-98fb07f0-559f-42f7-b310-328a160234f7 req-22a762e4-d7f3-42c9-a183-40069f1732a1 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-98fb07f0-559f-42f7-b310-328a160234f7 req-22a762e4-d7f3-42c9-a183-40069f1732a1 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:02:35 user nova-compute[73254]: WARNING nova.compute.manager [req-98fb07f0-559f-42f7-b310-328a160234f7 req-22a762e4-d7f3-42c9-a183-40069f1732a1 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state active and task_state resize_finish.
Aug 14 15:02:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025357.1996284, 0110dafc-b336-45bd-aade-0eb9ba632a05 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:02:37 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] VM Resumed (Lifecycle Event)
Aug 14 15:02:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance running successfully.
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Failed to set time: agent not configured {{(pid=73254) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7d63d0c7-dab2-4357-93d0-4afa6c155938 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] finish_migration finished successfully. {{(pid=73254) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:02:37 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025357.1998239, 0110dafc-b336-45bd-aade-0eb9ba632a05 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:02:37 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] VM Started (Lifecycle Event)
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:02:37 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:37 user nova-compute[73254]: INFO nova.compute.manager [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Terminating instance
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-4754a6c0-100c-4dc9-a388-9fee5b0ec95f req-0c40094a-8025-4294-8a81-f90a699b75d7 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-unplugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4754a6c0-100c-4dc9-a388-9fee5b0ec95f req-0c40094a-8025-4294-8a81-f90a699b75d7 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4754a6c0-100c-4dc9-a388-9fee5b0ec95f req-0c40094a-8025-4294-8a81-f90a699b75d7 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4754a6c0-100c-4dc9-a388-9fee5b0ec95f req-0c40094a-8025-4294-8a81-f90a699b75d7 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-4754a6c0-100c-4dc9-a388-9fee5b0ec95f req-0c40094a-8025-4294-8a81-f90a699b75d7 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No waiting events found dispatching network-vif-unplugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-4754a6c0-100c-4dc9-a388-9fee5b0ec95f req-0c40094a-8025-4294-8a81-f90a699b75d7 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-unplugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-41dfd351-ab65-4b18-980c-4eaf0a9dd3ec req-727725e4-6098-4b87-b169-a0377e884404 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-41dfd351-ab65-4b18-980c-4eaf0a9dd3ec req-727725e4-6098-4b87-b169-a0377e884404 service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-41dfd351-ab65-4b18-980c-4eaf0a9dd3ec req-727725e4-6098-4b87-b169-a0377e884404 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-41dfd351-ab65-4b18-980c-4eaf0a9dd3ec req-727725e4-6098-4b87-b169-a0377e884404 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-41dfd351-ab65-4b18-980c-4eaf0a9dd3ec req-727725e4-6098-4b87-b169-a0377e884404 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:02:37 user nova-compute[73254]: WARNING nova.compute.manager [req-41dfd351-ab65-4b18-980c-4eaf0a9dd3ec req-727725e4-6098-4b87-b169-a0377e884404 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state resized and task_state None.
Aug 14 15:02:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:38 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Instance destroyed successfully.
Aug 14 15:02:38 user nova-compute[73254]: DEBUG nova.objects.instance [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lazy-loading 'resources' on Instance uuid 0674641b-1cd6-43ba-9970-f3cdd88a2b59 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T14:58:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-296607428',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1973214659',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFl33XV+x9ts4rv7WJNVvYshjSa8TNqiIrMQzBrp0O6ibe77tIbQntCMYwdBaWlciKrpx8xErIU9j4DjFDlicSBbUrowd40KRU/vV0pPoHS0beUaHWL5ciQBFkq3LACXTg==',key_name='tempest-keypair-1229858273',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:01:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b96039e862a54a568460bdc32c225857',ramdisk_id='',reservation_id='r-ta92if1e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-446563179',owner_user_name='tempest-ServerActionsV293TestJSON-446563179-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:01:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='39db94ce446a44e6941ad7c0b7eab92d',uuid=0674641b-1cd6-43ba-9970-f3cdd88a2b59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converting VIF {"id": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "address": "fa:16:3e:f4:f8:9a", "network": {"id": "e65cd600-920c-4c69-bd38-db489ce4645a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-671169437-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b96039e862a54a568460bdc32c225857", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapac8d1a73-4e", "ovs_interfaceid": "ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_vif [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapac8d1a73-4e, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:02:38 user nova-compute[73254]: INFO os_vif [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:f8:9a,bridge_name='br-int',has_traffic_filtering=True,id=ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36,network=Network(e65cd600-920c-4c69-bd38-db489ce4645a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapac8d1a73-4e')
Aug 14 15:02:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XLqsucOV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:38 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b49455-43ef-4edb-b382-cad0007dcee4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5d790a-73ce-4f6f-9f74-2bee0386efc9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:38 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:38 user nova-compute[73254]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:38 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 (non-flash)
Aug 14 15:02:38 user nova-compute[73254]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:38 user nova-compute[73254]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:38 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648550160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[af671ee1-0976-45e5-a429-f2ef9b1453b4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.034s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[28374428-44cc-40e6-b2e7-c3b72da7980f]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[187f0db0-208b-45ad-9a3b-baa3596c9f23]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fc2cb5-3a07-4c80-9461-0ffc493867ec]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[791f6066-f2a8-41be-bd83-549ebf580343]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf60bc4-17a6-407e-9cee-561c74e2cb25]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260]
Aug 14 15:02:38 user nova-compute[73254]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8, portal: 172.16.0.220,3260] successful.
Aug 14 15:02:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5de596b1-5e07-4efd-986b-2e7161d89cb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.185s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9cc00a8-5946-4ba8-ae0d-cc9c097855cb]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.561s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] <== disconnect_volume: return (562ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:02:38 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Deleting instance files /opt/stack/data/nova/instances/0674641b-1cd6-43ba-9970-f3cdd88a2b59_del
Aug 14 15:02:38 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Deletion of /opt/stack/data/nova/instances/0674641b-1cd6-43ba-9970-f3cdd88a2b59_del complete
Aug 14 15:02:39 user nova-compute[73254]: INFO nova.compute.manager [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Took 1.53 seconds to destroy the instance on the hypervisor.
Aug 14 15:02:39 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:02:39 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:02:39 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:02:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-1f1f61bc-98f8-4899-88d4-580ef390c530 req-2f665f9c-0fa5-49dc-8ee7-cd653d131824 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1f1f61bc-98f8-4899-88d4-580ef390c530 req-2f665f9c-0fa5-49dc-8ee7-cd653d131824 service nova] Acquiring lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1f1f61bc-98f8-4899-88d4-580ef390c530 req-2f665f9c-0fa5-49dc-8ee7-cd653d131824 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1f1f61bc-98f8-4899-88d4-580ef390c530 req-2f665f9c-0fa5-49dc-8ee7-cd653d131824 service nova] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-1f1f61bc-98f8-4899-88d4-580ef390c530 req-2f665f9c-0fa5-49dc-8ee7-cd653d131824 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] No waiting events found dispatching network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:02:39 user nova-compute[73254]: WARNING nova.compute.manager [req-1f1f61bc-98f8-4899-88d4-580ef390c530 req-2f665f9c-0fa5-49dc-8ee7-cd653d131824 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received unexpected event network-vif-plugged-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 for instance with vm_state active and task_state deleting.
Aug 14 15:02:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:41 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:41 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Took 2.00 seconds to deallocate network for instance.
Aug 14 15:02:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-68b7b3fe-3951-48a0-abc3-14c7bd6e7285 req-36b0f1ea-834b-43c9-b2ee-5117598ed6b0 service nova] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Received event network-vif-deleted-ac8d1a73-4e15-4ece-9c7c-ce3745e3ad36 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "06fb12cd-0594-4480-ac26-2b30861395f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:41 user nova-compute[73254]: INFO nova.compute.manager [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Took 0.87 seconds to detach 1 volumes for instance.
Aug 14 15:02:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Deleting volume: 5de596b1-5e07-4efd-986b-2e7161d89cb8 {{(pid=73254) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 15:02:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:02:42 user nova-compute[73254]: INFO nova.compute.claims [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Claim successful on node user
Aug 14 15:02:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.619s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.588s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:02:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:02:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-7206375d-ddcd-4a70-b69d-8abfa35d41cf req-80f2e184-6116-46d8-85e6-540015af7f42 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-changed-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-7206375d-ddcd-4a70-b69d-8abfa35d41cf req-80f2e184-6116-46d8-85e6-540015af7f42 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Refreshing instance network info cache due to event network-changed-54c73d11-8f49-4e16-ae68-750d0c2cea9b. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7206375d-ddcd-4a70-b69d-8abfa35d41cf req-80f2e184-6116-46d8-85e6-540015af7f42 service nova] Acquiring lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7206375d-ddcd-4a70-b69d-8abfa35d41cf req-80f2e184-6116-46d8-85e6-540015af7f42 service nova] Acquired lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:42 user nova-compute[73254]: DEBUG nova.network.neutron [req-7206375d-ddcd-4a70-b69d-8abfa35d41cf req-80f2e184-6116-46d8-85e6-540015af7f42 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Refreshing network info cache for port 54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:02:42 user nova-compute[73254]: INFO nova.virt.block_device [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Booting with volume d35b10ca-0ded-44c2-8b0b-bee1a97846b7 at /dev/vda
Aug 14 15:02:43 user nova-compute[73254]: DEBUG os_brick.utils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c0cf39-3469-4041-9a27-affefd0dba4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[92867202-6ac7-436c-b2ec-275274547b75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d768ed5f-aa9c-4a57-8d41-58a3390739f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[da485291-e2c0-464b-9592-b3d850bfb2fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG nova.policy [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6ef72f44e2ac4160aa748eb4d7cb8393', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47c7b8d6f369479c8e42326b58efdef5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:43 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8650d7bc-125e-46c6-b842-f3dd916143d8]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG os_brick.utils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating existing volume attachment record: 14555d71-e5ec-4cda-b451-19ae802bfcb6 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.580s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:43 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Deleted allocations for instance 0674641b-1cd6-43ba-9970-f3cdd88a2b59
Aug 14 15:02:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-149ce0f8-7d0d-4698-abd1-9e8ae017f1bf tempest-ServerActionsV293TestJSON-446563179 tempest-ServerActionsV293TestJSON-446563179-project-member] Lock "0674641b-1cd6-43ba-9970-f3cdd88a2b59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.937s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG nova.network.neutron [req-7206375d-ddcd-4a70-b69d-8abfa35d41cf req-80f2e184-6116-46d8-85e6-540015af7f42 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updated VIF entry in instance network info cache for port 54c73d11-8f49-4e16-ae68-750d0c2cea9b. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG nova.network.neutron [req-7206375d-ddcd-4a70-b69d-8abfa35d41cf req-80f2e184-6116-46d8-85e6-540015af7f42 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updating instance_info_cache with network_info: [{"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7206375d-ddcd-4a70-b69d-8abfa35d41cf req-80f2e184-6116-46d8-85e6-540015af7f42 service nova] Releasing lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully created port: 6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:02:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully created port: 4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:02:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully created port: 7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:02:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-7428306b-b64f-4ff4-b644-60379c22d1c1 req-c7b2aba4-3c1c-4022-865e-6147681454f7 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-changed-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-7428306b-b64f-4ff4-b644-60379c22d1c1 req-c7b2aba4-3c1c-4022-865e-6147681454f7 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Refreshing instance network info cache due to event network-changed-54c73d11-8f49-4e16-ae68-750d0c2cea9b. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:02:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7428306b-b64f-4ff4-b644-60379c22d1c1 req-c7b2aba4-3c1c-4022-865e-6147681454f7 service nova] Acquiring lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7428306b-b64f-4ff4-b644-60379c22d1c1 req-c7b2aba4-3c1c-4022-865e-6147681454f7 service nova] Acquired lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:46 user nova-compute[73254]: DEBUG nova.network.neutron [req-7428306b-b64f-4ff4-b644-60379c22d1c1 req-c7b2aba4-3c1c-4022-865e-6147681454f7 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Refreshing network info cache for port 54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:02:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-7428306b-b64f-4ff4-b644-60379c22d1c1 req-c7b2aba4-3c1c-4022-865e-6147681454f7 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updated VIF entry in instance network info cache for port 54c73d11-8f49-4e16-ae68-750d0c2cea9b. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:02:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-7428306b-b64f-4ff4-b644-60379c22d1c1 req-c7b2aba4-3c1c-4022-865e-6147681454f7 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updating instance_info_cache with network_info: [{"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7428306b-b64f-4ff4-b644-60379c22d1c1 req-c7b2aba4-3c1c-4022-865e-6147681454f7 service nova] Releasing lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:47 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully created port: e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:02:47 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully created port: 2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:02:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:49 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully updated port: 6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:02:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-88e45b9c-3019-4450-9ab2-ae783a618340 req-b5c8d3a4-0cff-4599-9efe-3565ba953732 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-changed-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-88e45b9c-3019-4450-9ab2-ae783a618340 req-b5c8d3a4-0cff-4599-9efe-3565ba953732 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing instance network info cache due to event network-changed-6a6169be-8600-4e65-8b26-6324edf3e09b. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:02:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-88e45b9c-3019-4450-9ab2-ae783a618340 req-b5c8d3a4-0cff-4599-9efe-3565ba953732 service nova] Acquiring lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-88e45b9c-3019-4450-9ab2-ae783a618340 req-b5c8d3a4-0cff-4599-9efe-3565ba953732 service nova] Acquired lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:49 user nova-compute[73254]: DEBUG nova.network.neutron [req-88e45b9c-3019-4450-9ab2-ae783a618340 req-b5c8d3a4-0cff-4599-9efe-3565ba953732 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing network info cache for port 6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:02:49 user nova-compute[73254]: DEBUG nova.network.neutron [req-88e45b9c-3019-4450-9ab2-ae783a618340 req-b5c8d3a4-0cff-4599-9efe-3565ba953732 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:02:50 user nova-compute[73254]: DEBUG nova.network.neutron [req-88e45b9c-3019-4450-9ab2-ae783a618340 req-b5c8d3a4-0cff-4599-9efe-3565ba953732 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-88e45b9c-3019-4450-9ab2-ae783a618340 req-b5c8d3a4-0cff-4599-9efe-3565ba953732 service nova] Releasing lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully updated port: c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:02:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-6c1a03d0-3ba2-4e79-ac6a-8c66b03cd172 req-3eca9ad6-0d69-4ccd-8846-5660634040f3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-changed-c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-6c1a03d0-3ba2-4e79-ac6a-8c66b03cd172 req-3eca9ad6-0d69-4ccd-8846-5660634040f3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing instance network info cache due to event network-changed-c270397e-5814-41e1-b5ed-4f39de1c5e72. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:02:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6c1a03d0-3ba2-4e79-ac6a-8c66b03cd172 req-3eca9ad6-0d69-4ccd-8846-5660634040f3 service nova] Acquiring lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6c1a03d0-3ba2-4e79-ac6a-8c66b03cd172 req-3eca9ad6-0d69-4ccd-8846-5660634040f3 service nova] Acquired lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-6c1a03d0-3ba2-4e79-ac6a-8c66b03cd172 req-3eca9ad6-0d69-4ccd-8846-5660634040f3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing network info cache for port c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:02:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-6c1a03d0-3ba2-4e79-ac6a-8c66b03cd172 req-3eca9ad6-0d69-4ccd-8846-5660634040f3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:02:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:52 user nova-compute[73254]: DEBUG nova.network.neutron [req-6c1a03d0-3ba2-4e79-ac6a-8c66b03cd172 req-3eca9ad6-0d69-4ccd-8846-5660634040f3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6c1a03d0-3ba2-4e79-ac6a-8c66b03cd172 req-3eca9ad6-0d69-4ccd-8846-5660634040f3 service nova] Releasing lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:52 user nova-compute[73254]: INFO nova.compute.manager [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Rebooting instance
Aug 14 15:02:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquired lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:52 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:02:53 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updating instance_info_cache with network_info: [{"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Releasing lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:02:53 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025358.339303, 0674641b-1cd6-43ba-9970-f3cdd88a2b59 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:02:53 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] VM Stopped (Lifecycle Event)
Aug 14 15:02:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ccdc454e-9285-4776-9a1f-82a9c90357a7 None None] [instance: 0674641b-1cd6-43ba-9970-f3cdd88a2b59] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:02:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:53 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully updated port: 44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:02:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-df0e753e-1a08-43ac-9028-db3a95832567 req-6f436249-abf8-4239-b871-2b7264c9865e service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-changed-44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-df0e753e-1a08-43ac-9028-db3a95832567 req-6f436249-abf8-4239-b871-2b7264c9865e service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing instance network info cache due to event network-changed-44883790-f1ca-4d2b-b347-3f6b61a5f113. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-df0e753e-1a08-43ac-9028-db3a95832567 req-6f436249-abf8-4239-b871-2b7264c9865e service nova] Acquiring lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-df0e753e-1a08-43ac-9028-db3a95832567 req-6f436249-abf8-4239-b871-2b7264c9865e service nova] Acquired lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.network.neutron [req-df0e753e-1a08-43ac-9028-db3a95832567 req-6f436249-abf8-4239-b871-2b7264c9865e service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing network info cache for port 44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:02:54 user nova-compute[73254]: INFO nova.compute.claims [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Claim successful on node user
Aug 14 15:02:54 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Instance destroyed successfully.
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'resources' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.network.neutron [req-df0e753e-1a08-43ac-9028-db3a95832567 req-6f436249-abf8-4239-b871-2b7264c9865e service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230610477',display_name='tempest-TestMinimumBasicScenario-server-230610477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230610477',id=13,image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5ULTwch7uAvfJ98sDf6jNl80RmElLj5L4Z/IsYvkUB78J8+ETM0qoah7POpI+iRPMndWlC9GBpuQk3Hewhkl3N7ftFItYhb2+jfwzTfkCI1veITs45QF0ygrq6l6wz1Q==',key_name='tempest-TestMinimumBasicScenario-2005249306',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='038244b91aad403897eb49752db371e7',ramdisk_id='',reservation_id='r-3h6820pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-270556114',owner_user_name='tempest-TestMinimumBasicScenario-270556114-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:02:53Z,user_data=None,user_id='55b05671f1cb4c05a7bedb3559968162',uuid=81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converting VIF {"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_vif [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54c73d11-8f, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:54 user nova-compute[73254]: INFO os_vif [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f')
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdVQgqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:54 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db562c3-7827-4a8b-bcd7-1c76d2a847d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[096c1ef4-ef42-4047-87c9-9b2d8c7930b4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:54 user nova-compute[73254]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:54 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:54 user nova-compute[73254]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:54 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648570700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932'): ({'sdd'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Removing single pathed devices sdd {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc763c-fd4e-4027-a0e4-5e5be0db6044]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[be63ecae-fa90-4805-901f-2c40c1467dfc]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Flushing IO for device /dev/sdd {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b821990-4d7e-430a-8d53-4a630a00895d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53de346-b1f4-4e45-a74d-460f22b14d96]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfd497f-0824-4202-91ef-899f026ca9df]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.network.neutron [req-df0e753e-1a08-43ac-9028-db3a95832567 req-6f436249-abf8-4239-b871-2b7264c9865e service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-df0e753e-1a08-43ac-9028-db3a95832567 req-6f436249-abf8-4239-b871-2b7264c9865e service nova] Releasing lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[684e0dd3-b95b-4a73-9580-20815568ed7c]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260]
Aug 14 15:02:54 user nova-compute[73254]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260] successful.
Aug 14 15:02:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2747af5a-7d25-435d-83cf-971210eefa86]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] <== disconnect_volume: return (330ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Start _get_guest_xml network_info=[{"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0220f8b-97d4-42fe-9697-e709062be4a4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': 'a0220f8b-97d4-42fe-9697-e709062be4a4'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '47cd7ddc-e6d1-4b35-b2ec-a2f931e9ddf3', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdVQgqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7', 'attached_at': '', 'detached_at': '', 'volume_id': '5e02d324-2e59-4152-a018-d6f65bbd0932', 'serial': '5e02d324-2e59-4152-a018-d6f65bbd0932'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:02:54 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:02:54 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:02:54 user nova-compute[73254]: INFO nova.virt.block_device [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Booting with volume 5407c0ea-ce29-4489-b1c6-785a2630b26e at /dev/vdb
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a0220f8b-97d4-42fe-9697-e709062be4a4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'vcpu_model' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdVQgqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:54 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:54 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:02:54 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.utils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d283dee5-f3e2-4868-82ce-3d6158910dfc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:02:54 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[971df0ae-d4aa-46f8-9711-27844d357bcd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b534b2ef-dbb1-4b8d-906c-b0ebf2264b6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f67615b-bc02-4309-b2a4-6a8421d18161]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932] added
Aug 14 15:02:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa1b6ff-92ed-499f-b0ef-5144d5f842d2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f429222-b631-4f51-b6c5-9c05192e1d2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bdcb52c-b708-486d-b4d2-8c00402d1411]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully updated port: 4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5168a804-5473-4cc6-9968-661891e3498e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.692s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzdVQgqw {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:02:54 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2936daa-e578-4b18-a3bf-f868c9a85497]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.utils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating existing volume attachment record: 25f81385-34ae-4971-b5f2-64e1401b417a {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzdVQgqw" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b15b0d-d128-4701-8603-f6634ea2f9ee]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jzdVQgqw'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f868c2-c90b-436b-b955-1cadce8d8d5d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.network.neutron [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec16af29-1640-4c2b-9f9f-15bb2cb27672]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:54 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:54 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:54 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[05129781-da24-47e8-a101-77b4b0813d1f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260]
Aug 14 15:02:54 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260] successful.
Aug 14 15:02:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f67705d-5145-4fd7-bcba-c1e4eb9d94ba]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.policy [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5200b421cc6c4e45b91f547888fb896a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977830faf2af42dd8be28808611d8d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c998233-fa51-4ae6-87a9-d2e2f1d2d0f9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:55 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:55 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:02:55 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:02:55 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:02:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:02:55 user nova-compute[73254]: INFO nova.compute.claims [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Claim successful on node user
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2042be1-9682-45ae-9f5d-0e41329d9e8b]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdVQgqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:02:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Creating image(s)
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.198s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.211s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk 1073741824" returned: 0 in 0.102s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:02:55 user nova-compute[73254]: INFO nova.compute.manager [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] instance snapshotting
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully updated port: 7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.203s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.865s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:02:55 user nova-compute[73254]: DEBUG nova.network.neutron [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Successfully created port: 8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:02:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Beginning live snapshot process
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:02:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23939373232303230', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939373232303230', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Cannot resize image /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.objects.instance [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'migration_context' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Ensure instance console log exists: /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-changed-4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing instance network info cache due to event network-changed-4749498e-03d4-43ae-94e8-8b511f541730. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] Acquiring lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] Acquired lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.network.neutron [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing network info cache for port 4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230610477',display_name='tempest-TestMinimumBasicScenario-server-230610477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230610477',id=13,image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5ULTwch7uAvfJ98sDf6jNl80RmElLj5L4Z/IsYvkUB78J8+ETM0qoah7POpI+iRPMndWlC9GBpuQk3Hewhkl3N7ftFItYhb2+jfwzTfkCI1veITs45QF0ygrq6l6wz1Q==',key_name='tempest-TestMinimumBasicScenario-2005249306',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='038244b91aad403897eb49752db371e7',ramdisk_id='',reservation_id='r-3h6820pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-270556114',owner_user_name='tempest-TestMinimumBasicScenario-270556114-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:02:53Z,user_data=None,user_id='55b05671f1cb4c05a7bedb3559968162',uuid=81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converting VIF {"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'pci_devices' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.policy [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5200b421cc6c4e45b91f547888fb896a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977830faf2af42dd8be28808611d8d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:02:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Creating image(s)
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:02:56 user nova-compute[73254]:   <uuid>81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7</uuid>
Aug 14 15:02:56 user nova-compute[73254]:   <name>instance-0000000d</name>
Aug 14 15:02:56 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:02:56 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:02:56 user nova-compute[73254]:   <metadata>
Aug 14 15:02:56 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:02:56 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:02:56 user nova-compute[73254]:       <nova:name>tempest-TestMinimumBasicScenario-server-230610477</nova:name>
Aug 14 15:02:56 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:02:54</nova:creationTime>
Aug 14 15:02:56 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:02:56 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:02:56 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:02:56 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:02:56 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:02:56 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:02:56 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:02:56 user nova-compute[73254]:       <nova:owner>
Aug 14 15:02:56 user nova-compute[73254]:         <nova:user uuid="55b05671f1cb4c05a7bedb3559968162">tempest-TestMinimumBasicScenario-270556114-project-member</nova:user>
Aug 14 15:02:56 user nova-compute[73254]:         <nova:project uuid="038244b91aad403897eb49752db371e7">tempest-TestMinimumBasicScenario-270556114</nova:project>
Aug 14 15:02:56 user nova-compute[73254]:       </nova:owner>
Aug 14 15:02:56 user nova-compute[73254]:       <nova:root type="image" uuid="a0220f8b-97d4-42fe-9697-e709062be4a4"/>
Aug 14 15:02:56 user nova-compute[73254]:       <nova:ports>
Aug 14 15:02:56 user nova-compute[73254]:         <nova:port uuid="54c73d11-8f49-4e16-ae68-750d0c2cea9b">
Aug 14 15:02:56 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 15:02:56 user nova-compute[73254]:         </nova:port>
Aug 14 15:02:56 user nova-compute[73254]:       </nova:ports>
Aug 14 15:02:56 user nova-compute[73254]:     </nova:instance>
Aug 14 15:02:56 user nova-compute[73254]:   </metadata>
Aug 14 15:02:56 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:02:56 user nova-compute[73254]:     <system>
Aug 14 15:02:56 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:02:56 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:02:56 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:02:56 user nova-compute[73254]:       <entry name="serial">81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7</entry>
Aug 14 15:02:56 user nova-compute[73254]:       <entry name="uuid">81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7</entry>
Aug 14 15:02:56 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:02:56 user nova-compute[73254]:     </system>
Aug 14 15:02:56 user nova-compute[73254]:   </sysinfo>
Aug 14 15:02:56 user nova-compute[73254]:   <os>
Aug 14 15:02:56 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:02:56 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:02:56 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:02:56 user nova-compute[73254]:   </os>
Aug 14 15:02:56 user nova-compute[73254]:   <features>
Aug 14 15:02:56 user nova-compute[73254]:     <acpi/>
Aug 14 15:02:56 user nova-compute[73254]:     <apic/>
Aug 14 15:02:56 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:02:56 user nova-compute[73254]:   </features>
Aug 14 15:02:56 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:02:56 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:02:56 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:02:56 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:02:56 user nova-compute[73254]:   </clock>
Aug 14 15:02:56 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:02:56 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:02:56 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:02:56 user nova-compute[73254]:   </cpu>
Aug 14 15:02:56 user nova-compute[73254]:   <devices>
Aug 14 15:02:56 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:02:56 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:02:56 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk"/>
Aug 14 15:02:56 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:02:56 user nova-compute[73254]:     </disk>
Aug 14 15:02:56 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:02:56 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:02:56 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 15:02:56 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:02:56 user nova-compute[73254]:       <serial>5e02d324-2e59-4152-a018-d6f65bbd0932</serial>
Aug 14 15:02:56 user nova-compute[73254]:     </disk>
Aug 14 15:02:56 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:02:56 user nova-compute[73254]:       <mac address="fa:16:3e:53:33:f6"/>
Aug 14 15:02:56 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:02:56 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:02:56 user nova-compute[73254]:       <target dev="tap54c73d11-8f"/>
Aug 14 15:02:56 user nova-compute[73254]:     </interface>
Aug 14 15:02:56 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:02:56 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/console.log" append="off"/>
Aug 14 15:02:56 user nova-compute[73254]:     </serial>
Aug 14 15:02:56 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:02:56 user nova-compute[73254]:     <video>
Aug 14 15:02:56 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:02:56 user nova-compute[73254]:     </video>
Aug 14 15:02:56 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:02:56 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:02:56 user nova-compute[73254]:     </rng>
Aug 14 15:02:56 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:02:56 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:02:56 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:02:56 user nova-compute[73254]:     </memballoon>
Aug 14 15:02:56 user nova-compute[73254]:   </devices>
Aug 14 15:02:56 user nova-compute[73254]: </domain>
Aug 14 15:02:56 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json -f qcow2 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.network.neutron [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json -f qcow2" returned: 0 in 0.236s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json -f qcow2 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'trusted_certs' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.317s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json -f qcow2" returned: 0 in 0.244s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully updated port: e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk 1073741824" returned: 0 in 0.104s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.431s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.network.neutron [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72 --force-share --output=json" returned: 0 in 0.242s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] Releasing lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-changed-7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing instance network info cache due to event network-changed-7e8c649a-dac5-4c92-abaf-e3e18432294c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] Acquiring lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] Acquired lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.network.neutron [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing network info cache for port 7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqegt_6dp/373f1d69995b4c7d9d8f341d09db511b.delta 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.200s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqegt_6dp/373f1d69995b4c7d9d8f341d09db511b.delta 1073741824" returned: 0 in 0.103s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Cannot resize image /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'migration_context' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.network.neutron [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230610477',display_name='tempest-TestMinimumBasicScenario-server-230610477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230610477',id=13,image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5ULTwch7uAvfJ98sDf6jNl80RmElLj5L4Z/IsYvkUB78J8+ETM0qoah7POpI+iRPMndWlC9GBpuQk3Hewhkl3N7ftFItYhb2+jfwzTfkCI1veITs45QF0ygrq6l6wz1Q==',key_name='tempest-TestMinimumBasicScenario-2005249306',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='038244b91aad403897eb49752db371e7',ramdisk_id='',reservation_id='r-3h6820pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-270556114',owner_user_name='tempest-TestMinimumBasicScenario-270556114-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:53Z,user_data=None,user_id='55b05671f1cb4c05a7bedb3559968162',uuid=81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converting VIF {"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG os_vif [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54c73d11-8f, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54c73d11-8f, col_values=(('external_ids', {'iface-id': '54c73d11-8f49-4e16-ae68-750d0c2cea9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:33:f6', 'vm-uuid': '81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:57 user nova-compute[73254]: INFO os_vif [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f')
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Cannot resize image /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.objects.instance [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'migration_context' on Instance uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Ensure instance console log exists: /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.network.neutron [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c2b459d2-a565-4f43-b3c4-2b0695ac412b req-eb364ac8-707b-4351-b733-7d28a6c807b6 service nova] Releasing lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-caa6032b-ce9b-45aa-a8c5-e757139b412f req-c228165b-d852-4475-8820-0cd7d51846bc service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-vif-unplugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-caa6032b-ce9b-45aa-a8c5-e757139b412f req-c228165b-d852-4475-8820-0cd7d51846bc service nova] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-caa6032b-ce9b-45aa-a8c5-e757139b412f req-c228165b-d852-4475-8820-0cd7d51846bc service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-caa6032b-ce9b-45aa-a8c5-e757139b412f req-c228165b-d852-4475-8820-0cd7d51846bc service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-caa6032b-ce9b-45aa-a8c5-e757139b412f req-c228165b-d852-4475-8820-0cd7d51846bc service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] No waiting events found dispatching network-vif-unplugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:02:57 user nova-compute[73254]: WARNING nova.compute.manager [req-caa6032b-ce9b-45aa-a8c5-e757139b412f req-c228165b-d852-4475-8820-0cd7d51846bc service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received unexpected event network-vif-unplugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b for instance with vm_state active and task_state reboot_started_hard.
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.network.neutron [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Successfully created port: 61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:02:57 user nova-compute[73254]: DEBUG nova.network.neutron [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Successfully updated port: 8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquired lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Successfully updated port: 2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-37dd0050-f3ec-402d-a695-d50929c4d9ba req-52b5a364-5e15-45aa-8dbc-26d5bd7b3b8c service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-changed-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-37dd0050-f3ec-402d-a695-d50929c4d9ba req-52b5a364-5e15-45aa-8dbc-26d5bd7b3b8c service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Refreshing instance network info cache due to event network-changed-8e9c554c-79a1-4ed6-9be6-c168ff494302. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-37dd0050-f3ec-402d-a695-d50929c4d9ba req-52b5a364-5e15-45aa-8dbc-26d5bd7b3b8c service nova] Acquiring lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquired lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73254) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-changed-e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing instance network info cache due to event network-changed-e9bdf96e-8005-4693-9397-e17341995579. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] Acquiring lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] COPY block job progress, current cursor: 24182784 final cursor: 75563008 {{(pid=73254) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updating instance_info_cache with network_info: [{"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Releasing lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Instance network_info: |[{"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-37dd0050-f3ec-402d-a695-d50929c4d9ba req-52b5a364-5e15-45aa-8dbc-26d5bd7b3b8c service nova] Acquired lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.neutron [req-37dd0050-f3ec-402d-a695-d50929c4d9ba req-52b5a364-5e15-45aa-8dbc-26d5bd7b3b8c service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Refreshing network info cache for port 8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Start _get_guest_xml network_info=[{"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:02:58 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:02:58 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1369978089',display_name='tempest-ServerRescueNegativeTestJSON-server-1369978089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1369978089',id=16,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-tzspyfap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:55Z,user_data=None,user_id='5200b421cc6c4e45b91f547888fb896a',uuid=81ebd5b0-2b15-4dcd-801f-12f89938794c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=8e9c554c-79a1-4ed6-9be6-c168ff494302,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9c554c-79') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'pci_devices' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:02:58 user nova-compute[73254]:   <uuid>81ebd5b0-2b15-4dcd-801f-12f89938794c</uuid>
Aug 14 15:02:58 user nova-compute[73254]:   <name>instance-00000010</name>
Aug 14 15:02:58 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:02:58 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:02:58 user nova-compute[73254]:   <metadata>
Aug 14 15:02:58 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:02:58 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:02:58 user nova-compute[73254]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1369978089</nova:name>
Aug 14 15:02:58 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:02:58</nova:creationTime>
Aug 14 15:02:58 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:02:58 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:02:58 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:02:58 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:02:58 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:02:58 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:02:58 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:02:58 user nova-compute[73254]:       <nova:owner>
Aug 14 15:02:58 user nova-compute[73254]:         <nova:user uuid="5200b421cc6c4e45b91f547888fb896a">tempest-ServerRescueNegativeTestJSON-324663021-project-member</nova:user>
Aug 14 15:02:58 user nova-compute[73254]:         <nova:project uuid="977830faf2af42dd8be28808611d8d16">tempest-ServerRescueNegativeTestJSON-324663021</nova:project>
Aug 14 15:02:58 user nova-compute[73254]:       </nova:owner>
Aug 14 15:02:58 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:02:58 user nova-compute[73254]:       <nova:ports>
Aug 14 15:02:58 user nova-compute[73254]:         <nova:port uuid="8e9c554c-79a1-4ed6-9be6-c168ff494302">
Aug 14 15:02:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 15:02:58 user nova-compute[73254]:         </nova:port>
Aug 14 15:02:58 user nova-compute[73254]:       </nova:ports>
Aug 14 15:02:58 user nova-compute[73254]:     </nova:instance>
Aug 14 15:02:58 user nova-compute[73254]:   </metadata>
Aug 14 15:02:58 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:02:58 user nova-compute[73254]:     <system>
Aug 14 15:02:58 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:02:58 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:02:58 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:02:58 user nova-compute[73254]:       <entry name="serial">81ebd5b0-2b15-4dcd-801f-12f89938794c</entry>
Aug 14 15:02:58 user nova-compute[73254]:       <entry name="uuid">81ebd5b0-2b15-4dcd-801f-12f89938794c</entry>
Aug 14 15:02:58 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:02:58 user nova-compute[73254]:     </system>
Aug 14 15:02:58 user nova-compute[73254]:   </sysinfo>
Aug 14 15:02:58 user nova-compute[73254]:   <os>
Aug 14 15:02:58 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:02:58 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:02:58 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:02:58 user nova-compute[73254]:   </os>
Aug 14 15:02:58 user nova-compute[73254]:   <features>
Aug 14 15:02:58 user nova-compute[73254]:     <acpi/>
Aug 14 15:02:58 user nova-compute[73254]:     <apic/>
Aug 14 15:02:58 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:02:58 user nova-compute[73254]:   </features>
Aug 14 15:02:58 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:02:58 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:02:58 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:02:58 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:02:58 user nova-compute[73254]:   </clock>
Aug 14 15:02:58 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:02:58 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:02:58 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:02:58 user nova-compute[73254]:   </cpu>
Aug 14 15:02:58 user nova-compute[73254]:   <devices>
Aug 14 15:02:58 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:02:58 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:02:58 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk"/>
Aug 14 15:02:58 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:02:58 user nova-compute[73254]:     </disk>
Aug 14 15:02:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:02:58 user nova-compute[73254]:       <mac address="fa:16:3e:7d:b8:78"/>
Aug 14 15:02:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:02:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:02:58 user nova-compute[73254]:       <target dev="tap8e9c554c-79"/>
Aug 14 15:02:58 user nova-compute[73254]:     </interface>
Aug 14 15:02:58 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:02:58 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/console.log" append="off"/>
Aug 14 15:02:58 user nova-compute[73254]:     </serial>
Aug 14 15:02:58 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:02:58 user nova-compute[73254]:     <video>
Aug 14 15:02:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:02:58 user nova-compute[73254]:     </video>
Aug 14 15:02:58 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:02:58 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:02:58 user nova-compute[73254]:     </rng>
Aug 14 15:02:58 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:02:58 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:02:58 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:02:58 user nova-compute[73254]:     </memballoon>
Aug 14 15:02:58 user nova-compute[73254]:   </devices>
Aug 14 15:02:58 user nova-compute[73254]: </domain>
Aug 14 15:02:58 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1369978089',display_name='tempest-ServerRescueNegativeTestJSON-server-1369978089',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1369978089',id=16,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-tzspyfap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:55Z,user_data=None,user_id='5200b421cc6c4e45b91f547888fb896a',uuid=81ebd5b0-2b15-4dcd-801f-12f89938794c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=8e9c554c-79a1-4ed6-9be6-c168ff494302,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9c554c-79') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG os_vif [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=8e9c554c-79a1-4ed6-9be6-c168ff494302,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9c554c-79') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e9c554c-79, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e9c554c-79, col_values=(('external_ids', {'iface-id': '8e9c554c-79a1-4ed6-9be6-c168ff494302', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:b8:78', 'vm-uuid': '81ebd5b0-2b15-4dcd-801f-12f89938794c'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:02:58 user nova-compute[73254]: INFO os_vif [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=8e9c554c-79a1-4ed6-9be6-c168ff494302,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9c554c-79')
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:02:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No VIF found with MAC fa:16:3e:7d:b8:78, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:02:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73254) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 15:02:59 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 15:02:59 user nova-compute[73254]: DEBUG nova.network.neutron [req-37dd0050-f3ec-402d-a695-d50929c4d9ba req-52b5a364-5e15-45aa-8dbc-26d5bd7b3b8c service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updated VIF entry in instance network info cache for port 8e9c554c-79a1-4ed6-9be6-c168ff494302. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:02:59 user nova-compute[73254]: DEBUG nova.network.neutron [req-37dd0050-f3ec-402d-a695-d50929c4d9ba req-52b5a364-5e15-45aa-8dbc-26d5bd7b3b8c service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updating instance_info_cache with network_info: [{"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:02:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-37dd0050-f3ec-402d-a695-d50929c4d9ba req-52b5a364-5e15-45aa-8dbc-26d5bd7b3b8c service nova] Releasing lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:02:59 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:02:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqegt_6dp/373f1d69995b4c7d9d8f341d09db511b.delta /opt/stack/data/nova/instances/snapshots/tmpqegt_6dp/373f1d69995b4c7d9d8f341d09db511b {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:02:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-4667471b-3af3-48f3-9b7e-83c176b81f41 req-4a9c2aca-21bb-4f3c-b710-4b0a58899ef8 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:02:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4667471b-3af3-48f3-9b7e-83c176b81f41 req-4a9c2aca-21bb-4f3c-b710-4b0a58899ef8 service nova] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:02:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4667471b-3af3-48f3-9b7e-83c176b81f41 req-4a9c2aca-21bb-4f3c-b710-4b0a58899ef8 service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:02:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4667471b-3af3-48f3-9b7e-83c176b81f41 req-4a9c2aca-21bb-4f3c-b710-4b0a58899ef8 service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:02:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-4667471b-3af3-48f3-9b7e-83c176b81f41 req-4a9c2aca-21bb-4f3c-b710-4b0a58899ef8 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] No waiting events found dispatching network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:02:59 user nova-compute[73254]: WARNING nova.compute.manager [req-4667471b-3af3-48f3-9b7e-83c176b81f41 req-4a9c2aca-21bb-4f3c-b710-4b0a58899ef8 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received unexpected event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b for instance with vm_state active and task_state reboot_started_hard.
Aug 14 15:03:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqegt_6dp/373f1d69995b4c7d9d8f341d09db511b.delta /opt/stack/data/nova/instances/snapshots/tmpqegt_6dp/373f1d69995b4c7d9d8f341d09db511b" returned: 0 in 0.503s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:00 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Snapshot extracted, beginning image upload
Aug 14 15:03:00 user nova-compute[73254]: DEBUG nova.network.neutron [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Successfully updated port: 61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:03:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:03:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquired lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:03:00 user nova-compute[73254]: DEBUG nova.network.neutron [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:03:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-57d3cef1-1172-4f14-97c2-d537cd5da1bf req-2d777c96-834b-46b2-8535-5c8983472ed0 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-changed-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-57d3cef1-1172-4f14-97c2-d537cd5da1bf req-2d777c96-834b-46b2-8535-5c8983472ed0 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Refreshing instance network info cache due to event network-changed-61ad42be-874d-4f4f-84e4-b51b6c4a208e. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:03:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-57d3cef1-1172-4f14-97c2-d537cd5da1bf req-2d777c96-834b-46b2-8535-5c8983472ed0 service nova] Acquiring lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:03:00 user nova-compute[73254]: DEBUG nova.network.neutron [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:03:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.network.neutron [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Updating instance_info_cache with network_info: [{"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Releasing lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.compute.manager [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Instance network_info: |[{"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-57d3cef1-1172-4f14-97c2-d537cd5da1bf req-2d777c96-834b-46b2-8535-5c8983472ed0 service nova] Acquired lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.network.neutron [req-57d3cef1-1172-4f14-97c2-d537cd5da1bf req-2d777c96-834b-46b2-8535-5c8983472ed0 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Refreshing network info cache for port 61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Start _get_guest_xml network_info=[{"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-adbde93c-f3b4-44aa-92dc-58d4b0ad3e6b req-12d41770-3a66-43fa-9b9e-2920ed516e2a service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-adbde93c-f3b4-44aa-92dc-58d4b0ad3e6b req-12d41770-3a66-43fa-9b9e-2920ed516e2a service nova] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-adbde93c-f3b4-44aa-92dc-58d4b0ad3e6b req-12d41770-3a66-43fa-9b9e-2920ed516e2a service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-adbde93c-f3b4-44aa-92dc-58d4b0ad3e6b req-12d41770-3a66-43fa-9b9e-2920ed516e2a service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-adbde93c-f3b4-44aa-92dc-58d4b0ad3e6b req-12d41770-3a66-43fa-9b9e-2920ed516e2a service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] No waiting events found dispatching network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:01 user nova-compute[73254]: WARNING nova.compute.manager [req-adbde93c-f3b4-44aa-92dc-58d4b0ad3e6b req-12d41770-3a66-43fa-9b9e-2920ed516e2a service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received unexpected event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b for instance with vm_state active and task_state reboot_started_hard.
Aug 14 15:03:01 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:03:01 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1498207160',display_name='tempest-ServerRescueNegativeTestJSON-server-1498207160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1498207160',id=17,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-nidiuaun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:56Z,user_data=None,user_id='5200b421cc6c4e45b91f547888fb896a',uuid=52930af7-b452-4bff-a8cb-7e7859f99af6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:39:49,bridge_name='br-int',has_traffic_filtering=True,id=61ad42be-874d-4f4f-84e4-b51b6c4a208e,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ad42be-87') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.objects.instance [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'pci_devices' on Instance uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:03:01 user nova-compute[73254]:   <uuid>52930af7-b452-4bff-a8cb-7e7859f99af6</uuid>
Aug 14 15:03:01 user nova-compute[73254]:   <name>instance-00000011</name>
Aug 14 15:03:01 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:03:01 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:03:01 user nova-compute[73254]:   <metadata>
Aug 14 15:03:01 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:03:01 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:03:01 user nova-compute[73254]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1498207160</nova:name>
Aug 14 15:03:01 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:03:01</nova:creationTime>
Aug 14 15:03:01 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:03:01 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:03:01 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:03:01 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:03:01 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:03:01 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:03:01 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:03:01 user nova-compute[73254]:       <nova:owner>
Aug 14 15:03:01 user nova-compute[73254]:         <nova:user uuid="5200b421cc6c4e45b91f547888fb896a">tempest-ServerRescueNegativeTestJSON-324663021-project-member</nova:user>
Aug 14 15:03:01 user nova-compute[73254]:         <nova:project uuid="977830faf2af42dd8be28808611d8d16">tempest-ServerRescueNegativeTestJSON-324663021</nova:project>
Aug 14 15:03:01 user nova-compute[73254]:       </nova:owner>
Aug 14 15:03:01 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:03:01 user nova-compute[73254]:       <nova:ports>
Aug 14 15:03:01 user nova-compute[73254]:         <nova:port uuid="61ad42be-874d-4f4f-84e4-b51b6c4a208e">
Aug 14 15:03:01 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 15:03:01 user nova-compute[73254]:         </nova:port>
Aug 14 15:03:01 user nova-compute[73254]:       </nova:ports>
Aug 14 15:03:01 user nova-compute[73254]:     </nova:instance>
Aug 14 15:03:01 user nova-compute[73254]:   </metadata>
Aug 14 15:03:01 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:03:01 user nova-compute[73254]:     <system>
Aug 14 15:03:01 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:03:01 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:03:01 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:03:01 user nova-compute[73254]:       <entry name="serial">52930af7-b452-4bff-a8cb-7e7859f99af6</entry>
Aug 14 15:03:01 user nova-compute[73254]:       <entry name="uuid">52930af7-b452-4bff-a8cb-7e7859f99af6</entry>
Aug 14 15:03:01 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:03:01 user nova-compute[73254]:     </system>
Aug 14 15:03:01 user nova-compute[73254]:   </sysinfo>
Aug 14 15:03:01 user nova-compute[73254]:   <os>
Aug 14 15:03:01 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:03:01 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:03:01 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:03:01 user nova-compute[73254]:   </os>
Aug 14 15:03:01 user nova-compute[73254]:   <features>
Aug 14 15:03:01 user nova-compute[73254]:     <acpi/>
Aug 14 15:03:01 user nova-compute[73254]:     <apic/>
Aug 14 15:03:01 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:03:01 user nova-compute[73254]:   </features>
Aug 14 15:03:01 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:03:01 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:03:01 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:03:01 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:03:01 user nova-compute[73254]:   </clock>
Aug 14 15:03:01 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:03:01 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:03:01 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:03:01 user nova-compute[73254]:   </cpu>
Aug 14 15:03:01 user nova-compute[73254]:   <devices>
Aug 14 15:03:01 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:03:01 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:03:01 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk"/>
Aug 14 15:03:01 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:03:01 user nova-compute[73254]:     </disk>
Aug 14 15:03:01 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:03:01 user nova-compute[73254]:       <mac address="fa:16:3e:24:39:49"/>
Aug 14 15:03:01 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:01 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:03:01 user nova-compute[73254]:       <target dev="tap61ad42be-87"/>
Aug 14 15:03:01 user nova-compute[73254]:     </interface>
Aug 14 15:03:01 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:03:01 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/console.log" append="off"/>
Aug 14 15:03:01 user nova-compute[73254]:     </serial>
Aug 14 15:03:01 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:03:01 user nova-compute[73254]:     <video>
Aug 14 15:03:01 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:01 user nova-compute[73254]:     </video>
Aug 14 15:03:01 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:03:01 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:03:01 user nova-compute[73254]:     </rng>
Aug 14 15:03:01 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:03:01 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:03:01 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:03:01 user nova-compute[73254]:     </memballoon>
Aug 14 15:03:01 user nova-compute[73254]:   </devices>
Aug 14 15:03:01 user nova-compute[73254]: </domain>
Aug 14 15:03:01 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1498207160',display_name='tempest-ServerRescueNegativeTestJSON-server-1498207160',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1498207160',id=17,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-nidiuaun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:56Z,user_data=None,user_id='5200b421cc6c4e45b91f547888fb896a',uuid=52930af7-b452-4bff-a8cb-7e7859f99af6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:39:49,bridge_name='br-int',has_traffic_filtering=True,id=61ad42be-874d-4f4f-84e4-b51b6c4a208e,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ad42be-87') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG os_vif [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:39:49,bridge_name='br-int',has_traffic_filtering=True,id=61ad42be-874d-4f4f-84e4-b51b6c4a208e,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ad42be-87') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61ad42be-87, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap61ad42be-87, col_values=(('external_ids', {'iface-id': '61ad42be-874d-4f4f-84e4-b51b6c4a208e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:39:49', 'vm-uuid': '52930af7-b452-4bff-a8cb-7e7859f99af6'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:01 user nova-compute[73254]: INFO os_vif [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:39:49,bridge_name='br-int',has_traffic_filtering=True,id=61ad42be-874d-4f4f-84e4-b51b6c4a208e,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ad42be-87')
Aug 14 15:03:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:03:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No VIF found with MAC fa:16:3e:24:39:49, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:03:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG nova.network.neutron [req-57d3cef1-1172-4f14-97c2-d537cd5da1bf req-2d777c96-834b-46b2-8535-5c8983472ed0 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Updated VIF entry in instance network info cache for port 61ad42be-874d-4f4f-84e4-b51b6c4a208e. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG nova.network.neutron [req-57d3cef1-1172-4f14-97c2-d537cd5da1bf req-2d777c96-834b-46b2-8535-5c8983472ed0 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Updating instance_info_cache with network_info: [{"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-57d3cef1-1172-4f14-97c2-d537cd5da1bf req-2d777c96-834b-46b2-8535-5c8983472ed0 service nova] Releasing lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [{"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Releasing lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Instance network_info: |[{"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] Acquired lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG nova.network.neutron [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing network info cache for port e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:04 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Snapshot image upload complete
Aug 14 15:03:04 user nova-compute[73254]: INFO nova.compute.manager [None req-91326714-77f3-47eb-990b-04b2618cc8d8 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Took 8.18 seconds to snapshot the instance on the hypervisor.
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] No waiting events found dispatching network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:04 user nova-compute[73254]: WARNING nova.compute.manager [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received unexpected event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b for instance with vm_state active and task_state reboot_started_hard.
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:04 user nova-compute[73254]: WARNING nova.compute.manager [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state building and task_state spawning.
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:04 user nova-compute[73254]: WARNING nova.compute.manager [req-b880fda4-72cf-4e5a-b42e-bc3bf819b506 req-07ca0c42-96bf-48e5-b95b-fa56c8d4f006 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state building and task_state spawning.
Aug 14 15:03:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-ec713dfc-424b-4a93-a54b-6cb7d0f4723a req-f7ba9877-db96-4c1c-8b40-dcee9c8fe7c5 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ec713dfc-424b-4a93-a54b-6cb7d0f4723a req-f7ba9877-db96-4c1c-8b40-dcee9c8fe7c5 service nova] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ec713dfc-424b-4a93-a54b-6cb7d0f4723a req-f7ba9877-db96-4c1c-8b40-dcee9c8fe7c5 service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ec713dfc-424b-4a93-a54b-6cb7d0f4723a req-f7ba9877-db96-4c1c-8b40-dcee9c8fe7c5 service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-ec713dfc-424b-4a93-a54b-6cb7d0f4723a req-f7ba9877-db96-4c1c-8b40-dcee9c8fe7c5 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] No waiting events found dispatching network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:04 user nova-compute[73254]: WARNING nova.compute.manager [req-ec713dfc-424b-4a93-a54b-6cb7d0f4723a req-f7ba9877-db96-4c1c-8b40-dcee9c8fe7c5 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received unexpected event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e for instance with vm_state building and task_state spawning.
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025384.5455842, 81ebd5b0-2b15-4dcd-801f-12f89938794c => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:04 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] VM Resumed (Lifecycle Event)
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:04 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Instance spawned successfully.
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:04 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025384.5478866, 81ebd5b0-2b15-4dcd-801f-12f89938794c => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:04 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] VM Started (Lifecycle Event)
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:03:04 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Instance rebooted successfully.
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:04 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:03:04 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025384.7314773, 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:04 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] VM Resumed (Lifecycle Event)
Aug 14 15:03:05 user nova-compute[73254]: INFO nova.compute.manager [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Took 9.86 seconds to spawn the instance on the hypervisor.
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d497e820-fc23-42b7-9cd0-7e589b51185d tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 12.410s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.network.neutron [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updated VIF entry in instance network info cache for port e9bdf96e-8005-4693-9397-e17341995579. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.network.neutron [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [{"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025384.7353957, 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:05 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] VM Started (Lifecycle Event)
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] Releasing lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.compute.manager [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-changed-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.compute.manager [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing instance network info cache due to event network-changed-2aef43ab-d7ea-4775-a4bf-5bebce09ea29. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] Acquiring lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] Acquired lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.network.neutron [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing network info cache for port 2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:05 user nova-compute[73254]: INFO nova.compute.manager [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Took 11.09 seconds to build instance.
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json" returned: 0 in 0.376s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-abb8b384-603d-4f8b-8764-0430dc843f01 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.226s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:03:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updated VIF entry in instance network info cache for port 2aef43ab-d7ea-4775-a4bf-5bebce09ea29. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [{"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-321d1f85-1dcb-4500-a221-feb4858936af req-d784aa88-dfdf-46c5-8438-c0adb0bb00cd service nova] Releasing lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-25750f7c-797a-4154-84c2-f85b08aa3a7c req-a99c6a4c-234f-4fb5-bc2e-acfda83442ff service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-25750f7c-797a-4154-84c2-f85b08aa3a7c req-a99c6a4c-234f-4fb5-bc2e-acfda83442ff service nova] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-25750f7c-797a-4154-84c2-f85b08aa3a7c req-a99c6a4c-234f-4fb5-bc2e-acfda83442ff service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-25750f7c-797a-4154-84c2-f85b08aa3a7c req-a99c6a4c-234f-4fb5-bc2e-acfda83442ff service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-25750f7c-797a-4154-84c2-f85b08aa3a7c req-a99c6a4c-234f-4fb5-bc2e-acfda83442ff service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] No waiting events found dispatching network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:06 user nova-compute[73254]: WARNING nova.compute.manager [req-25750f7c-797a-4154-84c2-f85b08aa3a7c req-a99c6a4c-234f-4fb5-bc2e-acfda83442ff service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received unexpected event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e for instance with vm_state building and task_state spawning.
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:06 user nova-compute[73254]: INFO nova.virt.block_device [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Booting with volume 8abd2bcb-8c17-4f10-8248-b5eeb4e18202 at /dev/vdc
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG os_brick.utils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f88fef-c3a6-498f-a186-b4f2890c9a2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea4dd70-9208-4cb1-8a00-17b2d710fed6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[80447b76-74f1-44a4-8b45-b18d9185cbb4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de09302-8ba0-4a98-944d-d552666d233e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025387.0606945, 52930af7-b452-4bff-a8cb-7e7859f99af6 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:07 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] VM Resumed (Lifecycle Event)
Aug 14 15:03:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:07 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Instance spawned successfully.
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:03:07 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[56970263-1655-43fd-9c7b-6a606415ddda]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG os_brick.utils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] <== get_connector_properties: return (233ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating existing volume attachment record: 77736842-1a73-4fe9-b416-a1dcbdc8e1b3 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:07 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025387.0614893, 52930af7-b452-4bff-a8cb-7e7859f99af6 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:07 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] VM Started (Lifecycle Event)
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:07 user nova-compute[73254]: INFO nova.compute.manager [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Took 11.12 seconds to spawn the instance on the hypervisor.
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:07 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:07 user nova-compute[73254]: INFO nova.compute.manager [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Took 12.55 seconds to build instance.
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-23f88685-36c6-4940-90e0-2910929ccd3a tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.679s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:03:07 user nova-compute[73254]: INFO nova.compute.claims [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Claim successful on node user
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:08 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:03:08 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:03:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.085s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:09 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:03:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG nova.policy [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '473f1026828f41cc810fb66cf3715daf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7178e5b9b71a485ca1341c171795379e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:03:09 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Creating image(s)
Aug 14 15:03:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "/opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "/opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "/opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "f88075acd80977132aeb73538bb39d0c92358dba" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "f88075acd80977132aeb73538bb39d0c92358dba" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba.part --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Successfully created port: 4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 1.259s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba.part --force-share --output=json" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG nova.virt.images [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] 177fdb93-c2a2-4827-8bfe-2b3dbe9250db was qcow2, converting to raw {{(pid=73254) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba.part /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba.converted {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba.part /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba.converted" returned: 0 in 0.353s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba.converted --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.343s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "f88075acd80977132aeb73538bb39d0c92358dba" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.025s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "f88075acd80977132aeb73538bb39d0c92358dba" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "f88075acd80977132aeb73538bb39d0c92358dba" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba --force-share --output=json" returned: 0 in 0.772s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba,backing_fmt=raw /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Successfully updated port: 4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-e45f1ab6-efbb-4ad5-a478-056d6faaa674 req-ca651de7-3f99-4cbb-8088-f5fff3562e7d service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received event network-changed-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-e45f1ab6-efbb-4ad5-a478-056d6faaa674 req-ca651de7-3f99-4cbb-8088-f5fff3562e7d service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Refreshing instance network info cache due to event network-changed-4998f987-9e07-4317-b1b0-b0ee6c7cb815. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e45f1ab6-efbb-4ad5-a478-056d6faaa674 req-ca651de7-3f99-4cbb-8088-f5fff3562e7d service nova] Acquiring lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e45f1ab6-efbb-4ad5-a478-056d6faaa674 req-ca651de7-3f99-4cbb-8088-f5fff3562e7d service nova] Acquired lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.network.neutron [req-e45f1ab6-efbb-4ad5-a478-056d6faaa674 req-ca651de7-3f99-4cbb-8088-f5fff3562e7d service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Refreshing network info cache for port 4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba,backing_fmt=raw /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk 1073741824" returned: 0 in 0.074s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "f88075acd80977132aeb73538bb39d0c92358dba" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.851s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:03:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:03:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7343MB free_disk=25.45264434814453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.network.neutron [req-e45f1ab6-efbb-4ad5-a478-056d6faaa674 req-ca651de7-3f99-4cbb-8088-f5fff3562e7d service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba --force-share --output=json" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'migration_context' on Instance uuid 83808001-6b81-4479-86ff-94bb588d22fd {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Applying migration context for instance 0110dafc-b336-45bd-aade-0eb9ba632a05 as it has an incoming, in-progress migration 8c8f7735-76f7-4cdc-afeb-42761e7e9014. Migration status is finished {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 15:03:12 user nova-compute[73254]: INFO nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating resource usage from migration 8c8f7735-76f7-4cdc-afeb-42761e7e9014
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Ensure instance console log exists: /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 16996b6c-6d6e-4b51-88f3-0ca024e95639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance da915cb7-8ab5-4c65-928f-70e94811dd4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance fe35bcec-a10d-4554-8cd7-1a9d1a72f484 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 2d7ac783-716a-4c23-9466-fa7d5eae73a8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 73803036-4ad2-42b7-8d7e-40d2a97880fe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Migration 8c8f7735-76f7-4cdc-afeb-42761e7e9014 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0110dafc-b336-45bd-aade-0eb9ba632a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 06fb12cd-0594-4480-ac26-2b30861395f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 83808001-6b81-4479-86ff-94bb588d22fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=32GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.network.neutron [req-e45f1ab6-efbb-4ad5-a478-056d6faaa674 req-ca651de7-3f99-4cbb-8088-f5fff3562e7d service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e45f1ab6-efbb-4ad5-a478-056d6faaa674 req-ca651de7-3f99-4cbb-8088-f5fff3562e7d service nova] Releasing lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquired lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:03:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.723s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Updating instance_info_cache with network_info: [{"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Releasing lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Instance network_info: |[{"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Start _get_guest_xml network_info=[{"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9158be53127cadbc53df0692226db821',container_format='bare',created_at=2023-08-14T15:02:55Z,direct_url=<?>,disk_format='qcow2',id=177fdb93-c2a2-4827-8bfe-2b3dbe9250db,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1901804238',owner='7178e5b9b71a485ca1341c171795379e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T15:03:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '177fdb93-c2a2-4827-8bfe-2b3dbe9250db'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:03:13 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:03:13 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9158be53127cadbc53df0692226db821',container_format='bare',created_at=2023-08-14T15:02:55Z,direct_url=<?>,disk_format='qcow2',id=177fdb93-c2a2-4827-8bfe-2b3dbe9250db,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1901804238',owner='7178e5b9b71a485ca1341c171795379e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-14T15:03:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1382794950',display_name='tempest-TestStampPattern-server-1382794950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1382794950',id=18,image_ref='177fdb93-c2a2-4827-8bfe-2b3dbe9250db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaEzkBahIJ840YexSkejfPgB8Zu9IUTn4OhhFXFVyR7pO7f5lGzuSbxZ+sWUWa5xUvNWxRoCjcERWwoKcS9+q8odyZhEZxgpj4xugZIhdTa72+xL2CIyBYVuUyoIrEWBQ==',key_name='tempest-TestStampPattern-568033608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7178e5b9b71a485ca1341c171795379e',ramdisk_id='',reservation_id='r-a2gind3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4b878d88-e5f3-41b9-a399-c2da1806e1fc',image_min_disk='1',image_min_ram='0',image_owner_id='7178e5b9b71a485ca1341c171795379e',image_owner_project_name='tempest-TestStampPattern-1384631137',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1384631137-project-member',image_user_id='473f1026828f41cc810fb66cf3715daf',network_allocated='True',owner_project_name='tempest-TestStampPattern-1384631137',owner_user_name='tempest-TestStampPattern-1384631137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:03:09Z,user_data=None,user_id='473f1026828f41cc810fb66cf3715daf',uuid=83808001-6b81-4479-86ff-94bb588d22fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converting VIF {"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=4998f987-9e07-4317-b1b0-b0ee6c7cb815,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4998f987-9e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.objects.instance [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'pci_devices' on Instance uuid 83808001-6b81-4479-86ff-94bb588d22fd {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:03:13 user nova-compute[73254]:   <uuid>83808001-6b81-4479-86ff-94bb588d22fd</uuid>
Aug 14 15:03:13 user nova-compute[73254]:   <name>instance-00000012</name>
Aug 14 15:03:13 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:03:13 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:03:13 user nova-compute[73254]:   <metadata>
Aug 14 15:03:13 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:03:13 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:03:13 user nova-compute[73254]:       <nova:name>tempest-TestStampPattern-server-1382794950</nova:name>
Aug 14 15:03:13 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:03:13</nova:creationTime>
Aug 14 15:03:13 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:03:13 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:03:13 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:03:13 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:03:13 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:03:13 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:03:13 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:03:13 user nova-compute[73254]:       <nova:owner>
Aug 14 15:03:13 user nova-compute[73254]:         <nova:user uuid="473f1026828f41cc810fb66cf3715daf">tempest-TestStampPattern-1384631137-project-member</nova:user>
Aug 14 15:03:13 user nova-compute[73254]:         <nova:project uuid="7178e5b9b71a485ca1341c171795379e">tempest-TestStampPattern-1384631137</nova:project>
Aug 14 15:03:13 user nova-compute[73254]:       </nova:owner>
Aug 14 15:03:13 user nova-compute[73254]:       <nova:root type="image" uuid="177fdb93-c2a2-4827-8bfe-2b3dbe9250db"/>
Aug 14 15:03:13 user nova-compute[73254]:       <nova:ports>
Aug 14 15:03:13 user nova-compute[73254]:         <nova:port uuid="4998f987-9e07-4317-b1b0-b0ee6c7cb815">
Aug 14 15:03:13 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 15:03:13 user nova-compute[73254]:         </nova:port>
Aug 14 15:03:13 user nova-compute[73254]:       </nova:ports>
Aug 14 15:03:13 user nova-compute[73254]:     </nova:instance>
Aug 14 15:03:13 user nova-compute[73254]:   </metadata>
Aug 14 15:03:13 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:03:13 user nova-compute[73254]:     <system>
Aug 14 15:03:13 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:03:13 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:03:13 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:03:13 user nova-compute[73254]:       <entry name="serial">83808001-6b81-4479-86ff-94bb588d22fd</entry>
Aug 14 15:03:13 user nova-compute[73254]:       <entry name="uuid">83808001-6b81-4479-86ff-94bb588d22fd</entry>
Aug 14 15:03:13 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:03:13 user nova-compute[73254]:     </system>
Aug 14 15:03:13 user nova-compute[73254]:   </sysinfo>
Aug 14 15:03:13 user nova-compute[73254]:   <os>
Aug 14 15:03:13 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:03:13 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:03:13 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:03:13 user nova-compute[73254]:   </os>
Aug 14 15:03:13 user nova-compute[73254]:   <features>
Aug 14 15:03:13 user nova-compute[73254]:     <acpi/>
Aug 14 15:03:13 user nova-compute[73254]:     <apic/>
Aug 14 15:03:13 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:03:13 user nova-compute[73254]:   </features>
Aug 14 15:03:13 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:03:13 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:03:13 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:03:13 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:03:13 user nova-compute[73254]:   </clock>
Aug 14 15:03:13 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:03:13 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:03:13 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:03:13 user nova-compute[73254]:   </cpu>
Aug 14 15:03:13 user nova-compute[73254]:   <devices>
Aug 14 15:03:13 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:03:13 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:03:13 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk"/>
Aug 14 15:03:13 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:03:13 user nova-compute[73254]:     </disk>
Aug 14 15:03:13 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:03:13 user nova-compute[73254]:       <mac address="fa:16:3e:27:d1:85"/>
Aug 14 15:03:13 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:13 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:03:13 user nova-compute[73254]:       <target dev="tap4998f987-9e"/>
Aug 14 15:03:13 user nova-compute[73254]:     </interface>
Aug 14 15:03:13 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:03:13 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/console.log" append="off"/>
Aug 14 15:03:13 user nova-compute[73254]:     </serial>
Aug 14 15:03:13 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:03:13 user nova-compute[73254]:     <video>
Aug 14 15:03:13 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:13 user nova-compute[73254]:     </video>
Aug 14 15:03:13 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:03:13 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:03:13 user nova-compute[73254]:     </rng>
Aug 14 15:03:13 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:03:13 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:03:13 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:03:13 user nova-compute[73254]:     </memballoon>
Aug 14 15:03:13 user nova-compute[73254]:   </devices>
Aug 14 15:03:13 user nova-compute[73254]: </domain>
Aug 14 15:03:13 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1382794950',display_name='tempest-TestStampPattern-server-1382794950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1382794950',id=18,image_ref='177fdb93-c2a2-4827-8bfe-2b3dbe9250db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaEzkBahIJ840YexSkejfPgB8Zu9IUTn4OhhFXFVyR7pO7f5lGzuSbxZ+sWUWa5xUvNWxRoCjcERWwoKcS9+q8odyZhEZxgpj4xugZIhdTa72+xL2CIyBYVuUyoIrEWBQ==',key_name='tempest-TestStampPattern-568033608',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7178e5b9b71a485ca1341c171795379e',ramdisk_id='',reservation_id='r-a2gind3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4b878d88-e5f3-41b9-a399-c2da1806e1fc',image_min_disk='1',image_min_ram='0',image_owner_id='7178e5b9b71a485ca1341c171795379e',image_owner_project_name='tempest-TestStampPattern-1384631137',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1384631137-project-member',image_user_id='473f1026828f41cc810fb66cf3715daf',network_allocated='True',owner_project_name='tempest-TestStampPattern-1384631137',owner_user_name='tempest-TestStampPattern-1384631137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:03:09Z,user_data=None,user_id='473f1026828f41cc810fb66cf3715daf',uuid=83808001-6b81-4479-86ff-94bb588d22fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converting VIF {"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=4998f987-9e07-4317-b1b0-b0ee6c7cb815,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4998f987-9e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG os_vif [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=4998f987-9e07-4317-b1b0-b0ee6c7cb815,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4998f987-9e') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4998f987-9e, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4998f987-9e, col_values=(('external_ids', {'iface-id': '4998f987-9e07-4317-b1b0-b0ee6c7cb815', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:d1:85', 'vm-uuid': '83808001-6b81-4479-86ff-94bb588d22fd'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:13 user nova-compute[73254]: INFO os_vif [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=4998f987-9e07-4317-b1b0-b0ee6c7cb815,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4998f987-9e')
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:03:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] No VIF found with MAC fa:16:3e:27:d1:85, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:03:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:03:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:03:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:03:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:03:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:03:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Updating instance_info_cache with network_info: [{"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-fe35bcec-a10d-4554-8cd7-1a9d1a72f484" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-ee81a3a8-679a-438e-b3a4-3a7e7fe03c83 req-6e45c250-d6a7-4bab-8af2-216e2b46d403 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received event network-vif-plugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ee81a3a8-679a-438e-b3a4-3a7e7fe03c83 req-6e45c250-d6a7-4bab-8af2-216e2b46d403 service nova] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ee81a3a8-679a-438e-b3a4-3a7e7fe03c83 req-6e45c250-d6a7-4bab-8af2-216e2b46d403 service nova] Lock "83808001-6b81-4479-86ff-94bb588d22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ee81a3a8-679a-438e-b3a4-3a7e7fe03c83 req-6e45c250-d6a7-4bab-8af2-216e2b46d403 service nova] Lock "83808001-6b81-4479-86ff-94bb588d22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-ee81a3a8-679a-438e-b3a4-3a7e7fe03c83 req-6e45c250-d6a7-4bab-8af2-216e2b46d403 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] No waiting events found dispatching network-vif-plugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:15 user nova-compute[73254]: WARNING nova.compute.manager [req-ee81a3a8-679a-438e-b3a4-3a7e7fe03c83 req-6e45c250-d6a7-4bab-8af2-216e2b46d403 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received unexpected event network-vif-plugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 for instance with vm_state building and task_state spawning.
Aug 14 15:03:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025397.5592356, 83808001-6b81-4479-86ff-94bb588d22fd => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:17 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] VM Resumed (Lifecycle Event)
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:17 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Instance spawned successfully.
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-1f34ed72-af97-47b8-ab8f-ab6f0a512733 req-894fefdd-c1b1-47d2-990b-924de6ffe8a5 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received event network-vif-plugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1f34ed72-af97-47b8-ab8f-ab6f0a512733 req-894fefdd-c1b1-47d2-990b-924de6ffe8a5 service nova] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1f34ed72-af97-47b8-ab8f-ab6f0a512733 req-894fefdd-c1b1-47d2-990b-924de6ffe8a5 service nova] Lock "83808001-6b81-4479-86ff-94bb588d22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1f34ed72-af97-47b8-ab8f-ab6f0a512733 req-894fefdd-c1b1-47d2-990b-924de6ffe8a5 service nova] Lock "83808001-6b81-4479-86ff-94bb588d22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-1f34ed72-af97-47b8-ab8f-ab6f0a512733 req-894fefdd-c1b1-47d2-990b-924de6ffe8a5 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] No waiting events found dispatching network-vif-plugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:17 user nova-compute[73254]: WARNING nova.compute.manager [req-1f34ed72-af97-47b8-ab8f-ab6f0a512733 req-894fefdd-c1b1-47d2-990b-924de6ffe8a5 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received unexpected event network-vif-plugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 for instance with vm_state building and task_state spawning.
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:17 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025397.563444, 83808001-6b81-4479-86ff-94bb588d22fd => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:17 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] VM Started (Lifecycle Event)
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:17 user nova-compute[73254]: INFO nova.compute.manager [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Took 8.44 seconds to spawn the instance on the hypervisor.
Aug 14 15:03:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:17 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:03:17 user nova-compute[73254]: INFO nova.compute.manager [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Took 10.09 seconds to build instance.
Aug 14 15:03:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fca5443f-6ee8-47e4-8d88-401c5f2fe3bd tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.300s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:03:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Creating image(s)
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Ensure instance console log exists: /opt/stack/data/nova/instances/06fb12cd-0594-4480-ac26-2b30861395f6/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Start _get_guest_xml network_info=[{"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '14555d71-e5ec-4cda-b451-19ae802bfcb6', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRJGYAoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06fb12cd-0594-4480-ac26-2b30861395f6', 'attached_at': '', 'detached_at': '', 'volume_id': 'd35b10ca-0ded-44c2-8b0b-bee1a97846b7', 'serial': 'd35b10ca-0ded-44c2-8b0b-bee1a97846b7'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None}, {'attachment_id': '25f81385-34ae-4971-b5f2-64e1401b417a', 'disk_bus': 'virtio', 'boot_index': 1, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdTGDpbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06fb12cd-0594-4480-ac26-2b30861395f6', 'attached_at': '', 'detached_at': '', 'volume_id': '5407c0ea-ce29-4489-b1c6-785a2630b26e', 'serial': '5407c0ea-ce29-4489-b1c6-785a2630b26e'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None}, {'attachment_id': '77736842-1a73-4fe9-b416-a1dcbdc8e1b3', 'disk_bus': 'virtio', 'boot_index': 2, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zslPKUSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '06fb12cd-0594-4480-ac26-2b30861395f6', 'attached_at': '', 'detached_at': '', 'volume_id': '8abd2bcb-8c17-4f10-8248-b5eeb4e18202', 'serial': '8abd2bcb-8c17-4f10-8248-b5eeb4e18202'}, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:03:18 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:03:18 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRJGYAoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:03:18 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:03:18 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:03:18 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[248b18de-0c3c-41f0-8f3f-4f9100b8a343]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:03:18 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc819b1-420c-462d-b84b-228b7e5c371d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7] added
Aug 14 15:03:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e88b318-4233-41b7-8d2b-8102c6ff1d68]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5d7e7e-8101-4a34-8063-3bef900bfb04]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bRJGYAoO {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bRJGYAoO" returned: 0 in 0.036s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5de531-fef2-458d-9117-0063bb181c02]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bRJGYAoO'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[719bae2c-9963-46aa-9bb1-059f7024e42c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbe0814-67af-478f-8ef0-ea7bc40edc2e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:18 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:18 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:18 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:18 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e46dc9-f791-424e-9df3-5d0ed78a1b6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7, portal: 172.16.0.220,3260]
Aug 14 15:03:18 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7, portal: 172.16.0.220,3260] successful.
Aug 14 15:03:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4f8d92-58fa-4f85-92a9-90a053406348]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd3c018-c798-4845-a99c-1be545778325]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:19 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:19 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:19 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:19 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:19 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:19 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:19 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:19 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[db326195-89df-4cf4-9d77-a8bc21175de9]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:03:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRJGYAoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '26534306138656462', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534306138656462', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdTGDpbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:03:20 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:03:20 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:03:20 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acef8bb-ad71-492f-9524-ff48d48fc63f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:03:20 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dd86cc-bfba-4f57-b279-7ce0404cc79a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e] added
Aug 14 15:03:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[010775cd-ff78-422d-b4e7-83dfd802ea49]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e24e69e-ecd5-49fa-bc42-19b52cb5d6b3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdTGDpbj {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hdTGDpbj" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3e9a7e-5cbc-4b6a-9e3b-4b88ed6e7395]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hdTGDpbj'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b83093-0fac-4f9a-ba0c-d63491bef94f]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c39ae8-47c9-4b94-a7f7-faf61a20b6e9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea93eb56-a6d8-4856-9143-1a6bbe55440e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e, portal: 172.16.0.220,3260]
Aug 14 15:03:20 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e, portal: 172.16.0.220,3260] successful.
Aug 14 15:03:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bc1be8-d721-40e7-b36b-be36ee8cf212]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f73c878-be2d-4dcf-bab0-bfb4bb4ca2a7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:03:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:20 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:03:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[301b977a-3128-42f7-a176-8403c6c2b792]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:03:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdTGDpbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26631336537613038', 'path': '/dev/sdf'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631336537613038', 'path': '/dev/sdf'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zslPKUSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:03:21 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:03:21 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:03:21 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b2c9ec-b22e-4555-812b-d45c74a73d0f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:03:21 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f9656b-eb59-413a-a4c7-64c670873343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202] added
Aug 14 15:03:21 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[66413d79-084b-40e2-8437-d821813aa309]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[645ebd41-e617-4d56-8601-9d77ae2f8a79]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zslPKUSR {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zslPKUSR" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[19633657-b29b-44aa-9691-3a897cca25db]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zslPKUSR'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6ee8d3-82c7-4460-a8bf-f5f59267ef74]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a982be6-8aef-4859-9664-7dba293d9068]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:03:21 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:03:21 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --login" returned: 0 in 0.120s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b7612a-a371-40bf-9c8a-b30d5a127a56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202, portal: 172.16.0.220,3260]
Aug 14 15:03:21 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202, portal: 172.16.0.220,3260] successful.
Aug 14 15:03:21 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb712fd-eea2-4a05-b0dd-f1286e5bffa3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c22ce43-3940-4201-9517-8ab213c75884]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:03:21 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:03:21 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:03:21 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6637f6aa-5fea-4c3d-94d0-65e6c1f56d2b]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:21 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zslPKUSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23138316332313434', 'path': '/dev/sdg'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138316332313434', 'path': '/dev/sdg'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a1:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a6169be-8600-4e65-8b26-6324edf3e09b,network=Network(ccddfc19-cc5b-4090-98b9-1cfac0f137e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6169be-86') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d8:96,bridge_name='br-int',has_traffic_filtering=True,id=c270397e-5814-41e1-b5ed-4f39de1c5e72,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc270397e-58') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:00,bridge_name='br-int',has_traffic_filtering=True,id=44883790-f1ca-4d2b-b347-3f6b61a5f113,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44883790-f1') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:9c:00,bridge_name='br-int',has_traffic_filtering=True,id=4749498e-03d4-43ae-94e8-8b511f541730,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4749498e-03') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6f:27,bridge_name='br-int',has_traffic_filtering=True,id=7e8c649a-dac5-4c92-abaf-e3e18432294c,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c649a-da') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:85:c7,bridge_name='br-int',has_traffic_filtering=True,id=e9bdf96e-8005-4693-9397-e17341995579,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bdf96e-80') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:63:57,bridge_name='br-int',has_traffic_filtering=True,id=2aef43ab-d7ea-4775-a4bf-5bebce09ea29,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aef43ab-d7') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lazy-loading 'pci_devices' on Instance uuid 06fb12cd-0594-4480-ac26-2b30861395f6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:03:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:03:22 user nova-compute[73254]:   <uuid>06fb12cd-0594-4480-ac26-2b30861395f6</uuid>
Aug 14 15:03:22 user nova-compute[73254]:   <name>instance-0000000f</name>
Aug 14 15:03:22 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:03:22 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:03:22 user nova-compute[73254]:   <metadata>
Aug 14 15:03:22 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:03:22 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:03:22 user nova-compute[73254]:       <nova:name>tempest-device-tagging-server-885563793</nova:name>
Aug 14 15:03:22 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:03:18</nova:creationTime>
Aug 14 15:03:22 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:03:22 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:03:22 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:03:22 user nova-compute[73254]:       <nova:owner>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:user uuid="6ef72f44e2ac4160aa748eb4d7cb8393">tempest-TaggedBootDevicesTest_v242-555544937-project-member</nova:user>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:project uuid="47c7b8d6f369479c8e42326b58efdef5">tempest-TaggedBootDevicesTest_v242-555544937</nova:project>
Aug 14 15:03:22 user nova-compute[73254]:       </nova:owner>
Aug 14 15:03:22 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:03:22 user nova-compute[73254]:       <nova:ports>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:port uuid="6a6169be-8600-4e65-8b26-6324edf3e09b">
Aug 14 15:03:22 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 15:03:22 user nova-compute[73254]:         </nova:port>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:port uuid="c270397e-5814-41e1-b5ed-4f39de1c5e72">
Aug 14 15:03:22 user nova-compute[73254]:           <nova:ip type="fixed" address="10.1.1.145" ipVersion="4"/>
Aug 14 15:03:22 user nova-compute[73254]:         </nova:port>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:port uuid="44883790-f1ca-4d2b-b347-3f6b61a5f113">
Aug 14 15:03:22 user nova-compute[73254]:           <nova:ip type="fixed" address="10.1.1.94" ipVersion="4"/>
Aug 14 15:03:22 user nova-compute[73254]:         </nova:port>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:port uuid="4749498e-03d4-43ae-94e8-8b511f541730">
Aug 14 15:03:22 user nova-compute[73254]:           <nova:ip type="fixed" address="10.1.1.143" ipVersion="4"/>
Aug 14 15:03:22 user nova-compute[73254]:         </nova:port>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:port uuid="7e8c649a-dac5-4c92-abaf-e3e18432294c">
Aug 14 15:03:22 user nova-compute[73254]:           <nova:ip type="fixed" address="10.1.1.10" ipVersion="4"/>
Aug 14 15:03:22 user nova-compute[73254]:         </nova:port>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:port uuid="e9bdf96e-8005-4693-9397-e17341995579">
Aug 14 15:03:22 user nova-compute[73254]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 14 15:03:22 user nova-compute[73254]:         </nova:port>
Aug 14 15:03:22 user nova-compute[73254]:         <nova:port uuid="2aef43ab-d7ea-4775-a4bf-5bebce09ea29">
Aug 14 15:03:22 user nova-compute[73254]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 14 15:03:22 user nova-compute[73254]:         </nova:port>
Aug 14 15:03:22 user nova-compute[73254]:       </nova:ports>
Aug 14 15:03:22 user nova-compute[73254]:     </nova:instance>
Aug 14 15:03:22 user nova-compute[73254]:   </metadata>
Aug 14 15:03:22 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:03:22 user nova-compute[73254]:     <system>
Aug 14 15:03:22 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:03:22 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:03:22 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:03:22 user nova-compute[73254]:       <entry name="serial">06fb12cd-0594-4480-ac26-2b30861395f6</entry>
Aug 14 15:03:22 user nova-compute[73254]:       <entry name="uuid">06fb12cd-0594-4480-ac26-2b30861395f6</entry>
Aug 14 15:03:22 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:03:22 user nova-compute[73254]:     </system>
Aug 14 15:03:22 user nova-compute[73254]:   </sysinfo>
Aug 14 15:03:22 user nova-compute[73254]:   <os>
Aug 14 15:03:22 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:03:22 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:03:22 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:03:22 user nova-compute[73254]:   </os>
Aug 14 15:03:22 user nova-compute[73254]:   <features>
Aug 14 15:03:22 user nova-compute[73254]:     <acpi/>
Aug 14 15:03:22 user nova-compute[73254]:     <apic/>
Aug 14 15:03:22 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:03:22 user nova-compute[73254]:   </features>
Aug 14 15:03:22 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:03:22 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:03:22 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:03:22 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:03:22 user nova-compute[73254]:   </clock>
Aug 14 15:03:22 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:03:22 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:03:22 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:03:22 user nova-compute[73254]:   </cpu>
Aug 14 15:03:22 user nova-compute[73254]:   <devices>
Aug 14 15:03:22 user nova-compute[73254]:     <disk type="file" device="cdrom">
Aug 14 15:03:22 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none"/>
Aug 14 15:03:22 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/06fb12cd-0594-4480-ac26-2b30861395f6/disk.config"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="hda" bus="ide"/>
Aug 14 15:03:22 user nova-compute[73254]:     </disk>
Aug 14 15:03:22 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:03:22 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:03:22 user nova-compute[73254]:       <source dev="/dev/sdd"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:       <serial>d35b10ca-0ded-44c2-8b0b-bee1a97846b7</serial>
Aug 14 15:03:22 user nova-compute[73254]:     </disk>
Aug 14 15:03:22 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:03:22 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:03:22 user nova-compute[73254]:       <source dev="/dev/sdf"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:       <serial>5407c0ea-ce29-4489-b1c6-785a2630b26e</serial>
Aug 14 15:03:22 user nova-compute[73254]:     </disk>
Aug 14 15:03:22 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:03:22 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:03:22 user nova-compute[73254]:       <source dev="/dev/sdg"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="vdc" bus="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:       <serial>8abd2bcb-8c17-4f10-8248-b5eeb4e18202</serial>
Aug 14 15:03:22 user nova-compute[73254]:     </disk>
Aug 14 15:03:22 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:03:22 user nova-compute[73254]:       <mac address="fa:16:3e:7c:a1:eb"/>
Aug 14 15:03:22 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="tap6a6169be-86"/>
Aug 14 15:03:22 user nova-compute[73254]:     </interface>
Aug 14 15:03:22 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:03:22 user nova-compute[73254]:       <mac address="fa:16:3e:c5:d8:96"/>
Aug 14 15:03:22 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="tapc270397e-58"/>
Aug 14 15:03:22 user nova-compute[73254]:     </interface>
Aug 14 15:03:22 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:03:22 user nova-compute[73254]:       <mac address="fa:16:3e:4f:5a:00"/>
Aug 14 15:03:22 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="tap44883790-f1"/>
Aug 14 15:03:22 user nova-compute[73254]:     </interface>
Aug 14 15:03:22 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:03:22 user nova-compute[73254]:       <mac address="fa:16:3e:72:9c:00"/>
Aug 14 15:03:22 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="tap4749498e-03"/>
Aug 14 15:03:22 user nova-compute[73254]:     </interface>
Aug 14 15:03:22 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:03:22 user nova-compute[73254]:       <mac address="fa:16:3e:d3:6f:27"/>
Aug 14 15:03:22 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="tap7e8c649a-da"/>
Aug 14 15:03:22 user nova-compute[73254]:     </interface>
Aug 14 15:03:22 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:03:22 user nova-compute[73254]:       <mac address="fa:16:3e:58:85:c7"/>
Aug 14 15:03:22 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="tape9bdf96e-80"/>
Aug 14 15:03:22 user nova-compute[73254]:     </interface>
Aug 14 15:03:22 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:03:22 user nova-compute[73254]:       <mac address="fa:16:3e:24:63:57"/>
Aug 14 15:03:22 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:03:22 user nova-compute[73254]:       <target dev="tap2aef43ab-d7"/>
Aug 14 15:03:22 user nova-compute[73254]:     </interface>
Aug 14 15:03:22 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:03:22 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/06fb12cd-0594-4480-ac26-2b30861395f6/console.log" append="off"/>
Aug 14 15:03:22 user nova-compute[73254]:     </serial>
Aug 14 15:03:22 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:03:22 user nova-compute[73254]:     <video>
Aug 14 15:03:22 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:22 user nova-compute[73254]:     </video>
Aug 14 15:03:22 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:03:22 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:03:22 user nova-compute[73254]:     </rng>
Aug 14 15:03:22 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:03:22 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:03:22 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:03:22 user nova-compute[73254]:     </memballoon>
Aug 14 15:03:22 user nova-compute[73254]:   </devices>
Aug 14 15:03:22 user nova-compute[73254]: </domain>
Aug 14 15:03:22 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a1:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a6169be-8600-4e65-8b26-6324edf3e09b,network=Network(ccddfc19-cc5b-4090-98b9-1cfac0f137e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6169be-86') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a1:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a6169be-8600-4e65-8b26-6324edf3e09b,network=Network(ccddfc19-cc5b-4090-98b9-1cfac0f137e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6169be-86') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a6169be-86, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a6169be-86, col_values=(('external_ids', {'iface-id': '6a6169be-8600-4e65-8b26-6324edf3e09b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:a1:eb', 'vm-uuid': '06fb12cd-0594-4480-ac26-2b30861395f6'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: INFO os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:a1:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a6169be-8600-4e65-8b26-6324edf3e09b,network=Network(ccddfc19-cc5b-4090-98b9-1cfac0f137e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6169be-86')
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d8:96,bridge_name='br-int',has_traffic_filtering=True,id=c270397e-5814-41e1-b5ed-4f39de1c5e72,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc270397e-58') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d8:96,bridge_name='br-int',has_traffic_filtering=True,id=c270397e-5814-41e1-b5ed-4f39de1c5e72,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc270397e-58') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc270397e-58, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc270397e-58, col_values=(('external_ids', {'iface-id': 'c270397e-5814-41e1-b5ed-4f39de1c5e72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:d8:96', 'vm-uuid': '06fb12cd-0594-4480-ac26-2b30861395f6'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: INFO os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d8:96,bridge_name='br-int',has_traffic_filtering=True,id=c270397e-5814-41e1-b5ed-4f39de1c5e72,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc270397e-58')
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:00,bridge_name='br-int',has_traffic_filtering=True,id=44883790-f1ca-4d2b-b347-3f6b61a5f113,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44883790-f1') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:00,bridge_name='br-int',has_traffic_filtering=True,id=44883790-f1ca-4d2b-b347-3f6b61a5f113,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44883790-f1') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44883790-f1, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap44883790-f1, col_values=(('external_ids', {'iface-id': '44883790-f1ca-4d2b-b347-3f6b61a5f113', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:5a:00', 'vm-uuid': '06fb12cd-0594-4480-ac26-2b30861395f6'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: INFO os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:00,bridge_name='br-int',has_traffic_filtering=True,id=44883790-f1ca-4d2b-b347-3f6b61a5f113,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44883790-f1')
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:9c:00,bridge_name='br-int',has_traffic_filtering=True,id=4749498e-03d4-43ae-94e8-8b511f541730,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4749498e-03') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9c:00,bridge_name='br-int',has_traffic_filtering=True,id=4749498e-03d4-43ae-94e8-8b511f541730,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4749498e-03') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4749498e-03, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4749498e-03, col_values=(('external_ids', {'iface-id': '4749498e-03d4-43ae-94e8-8b511f541730', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:9c:00', 'vm-uuid': '06fb12cd-0594-4480-ac26-2b30861395f6'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: INFO os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9c:00,bridge_name='br-int',has_traffic_filtering=True,id=4749498e-03d4-43ae-94e8-8b511f541730,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4749498e-03')
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6f:27,bridge_name='br-int',has_traffic_filtering=True,id=7e8c649a-dac5-4c92-abaf-e3e18432294c,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c649a-da') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6f:27,bridge_name='br-int',has_traffic_filtering=True,id=7e8c649a-dac5-4c92-abaf-e3e18432294c,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c649a-da') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e8c649a-da, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7e8c649a-da, col_values=(('external_ids', {'iface-id': '7e8c649a-dac5-4c92-abaf-e3e18432294c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:6f:27', 'vm-uuid': '06fb12cd-0594-4480-ac26-2b30861395f6'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: INFO os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6f:27,bridge_name='br-int',has_traffic_filtering=True,id=7e8c649a-dac5-4c92-abaf-e3e18432294c,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c649a-da')
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:85:c7,bridge_name='br-int',has_traffic_filtering=True,id=e9bdf96e-8005-4693-9397-e17341995579,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bdf96e-80') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:85:c7,bridge_name='br-int',has_traffic_filtering=True,id=e9bdf96e-8005-4693-9397-e17341995579,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bdf96e-80') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9bdf96e-80, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9bdf96e-80, col_values=(('external_ids', {'iface-id': 'e9bdf96e-8005-4693-9397-e17341995579', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:85:c7', 'vm-uuid': '06fb12cd-0594-4480-ac26-2b30861395f6'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: INFO os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:85:c7,bridge_name='br-int',has_traffic_filtering=True,id=e9bdf96e-8005-4693-9397-e17341995579,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bdf96e-80')
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:02:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:63:57,bridge_name='br-int',has_traffic_filtering=True,id=2aef43ab-d7ea-4775-a4bf-5bebce09ea29,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aef43ab-d7') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:63:57,bridge_name='br-int',has_traffic_filtering=True,id=2aef43ab-d7ea-4775-a4bf-5bebce09ea29,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aef43ab-d7') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2aef43ab-d7, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2aef43ab-d7, col_values=(('external_ids', {'iface-id': '2aef43ab-d7ea-4775-a4bf-5bebce09ea29', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:63:57', 'vm-uuid': '06fb12cd-0594-4480-ac26-2b30861395f6'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:23 user nova-compute[73254]: INFO os_vif [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:63:57,bridge_name='br-int',has_traffic_filtering=True,id=2aef43ab-d7ea-4775-a4bf-5bebce09ea29,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aef43ab-d7')
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] No BDM found with device name hda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] No VIF found with MAC fa:16:3e:7c:a1:eb, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] No VIF found with MAC fa:16:3e:d3:6f:27, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:03:23 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Using config drive
Aug 14 15:03:23 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Creating config drive at /opt/stack/data/nova/instances/06fb12cd-0594-4480-ac26-2b30861395f6/disk.config
Aug 14 15:03:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/06fb12cd-0594-4480-ac26-2b30861395f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzfi8pbhl {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/06fb12cd-0594-4480-ac26-2b30861395f6/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzfi8pbhl" returned: 0 in 0.109s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-042d28f5-8b01-4bd3-9e44-2d1862fc7278 req-34c31909-e4ab-46ed-b217-19bce95f47f4 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-042d28f5-8b01-4bd3-9e44-2d1862fc7278 req-34c31909-e4ab-46ed-b217-19bce95f47f4 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-042d28f5-8b01-4bd3-9e44-2d1862fc7278 req-34c31909-e4ab-46ed-b217-19bce95f47f4 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-042d28f5-8b01-4bd3-9e44-2d1862fc7278 req-34c31909-e4ab-46ed-b217-19bce95f47f4 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-042d28f5-8b01-4bd3-9e44-2d1862fc7278 req-34c31909-e4ab-46ed-b217-19bce95f47f4 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:25 user nova-compute[73254]: WARNING nova.compute.manager [req-042d28f5-8b01-4bd3-9e44-2d1862fc7278 req-34c31909-e4ab-46ed-b217-19bce95f47f4 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-6a6169be-8600-4e65-8b26-6324edf3e09b for instance with vm_state building and task_state spawning.
Aug 14 15:03:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-1fc3ec21-83bc-4945-a2d7-36f6b5fb1e59 req-3f658e45-95d0-470a-ae77-fb498f89be89 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1fc3ec21-83bc-4945-a2d7-36f6b5fb1e59 req-3f658e45-95d0-470a-ae77-fb498f89be89 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1fc3ec21-83bc-4945-a2d7-36f6b5fb1e59 req-3f658e45-95d0-470a-ae77-fb498f89be89 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1fc3ec21-83bc-4945-a2d7-36f6b5fb1e59 req-3f658e45-95d0-470a-ae77-fb498f89be89 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-1fc3ec21-83bc-4945-a2d7-36f6b5fb1e59 req-3f658e45-95d0-470a-ae77-fb498f89be89 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:26 user nova-compute[73254]: WARNING nova.compute.manager [req-1fc3ec21-83bc-4945-a2d7-36f6b5fb1e59 req-3f658e45-95d0-470a-ae77-fb498f89be89 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 for instance with vm_state building and task_state spawning.
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-44e44af0-c4a9-4e5e-8eae-7e179e2c0c0e req-a7304977-5bfc-44fc-8125-0cee1dcc8a82 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-44e44af0-c4a9-4e5e-8eae-7e179e2c0c0e req-a7304977-5bfc-44fc-8125-0cee1dcc8a82 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-44e44af0-c4a9-4e5e-8eae-7e179e2c0c0e req-a7304977-5bfc-44fc-8125-0cee1dcc8a82 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-44e44af0-c4a9-4e5e-8eae-7e179e2c0c0e req-a7304977-5bfc-44fc-8125-0cee1dcc8a82 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-44e44af0-c4a9-4e5e-8eae-7e179e2c0c0e req-a7304977-5bfc-44fc-8125-0cee1dcc8a82 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:26 user nova-compute[73254]: WARNING nova.compute.manager [req-44e44af0-c4a9-4e5e-8eae-7e179e2c0c0e req-a7304977-5bfc-44fc-8125-0cee1dcc8a82 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-7e8c649a-dac5-4c92-abaf-e3e18432294c for instance with vm_state building and task_state spawning.
Aug 14 15:03:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:27 user nova-compute[73254]: WARNING nova.compute.manager [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-6a6169be-8600-4e65-8b26-6324edf3e09b for instance with vm_state building and task_state spawning.
Aug 14 15:03:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:27 user nova-compute[73254]: WARNING nova.compute.manager [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 for instance with vm_state building and task_state spawning.
Aug 14 15:03:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:27 user nova-compute[73254]: WARNING nova.compute.manager [req-6a365369-4bfe-4d2e-84eb-93333d264a13 req-594bc7f1-ab7b-471d-9f16-9a2b472cecf6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 for instance with vm_state building and task_state spawning.
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:28 user nova-compute[73254]: WARNING nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 for instance with vm_state building and task_state spawning.
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:28 user nova-compute[73254]: WARNING nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-4749498e-03d4-43ae-94e8-8b511f541730 for instance with vm_state building and task_state spawning.
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:28 user nova-compute[73254]: WARNING nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-4749498e-03d4-43ae-94e8-8b511f541730 for instance with vm_state building and task_state spawning.
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:28 user nova-compute[73254]: WARNING nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-e9bdf96e-8005-4693-9397-e17341995579 for instance with vm_state building and task_state spawning.
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:28 user nova-compute[73254]: WARNING nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-e9bdf96e-8005-4693-9397-e17341995579 for instance with vm_state building and task_state spawning.
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:28 user nova-compute[73254]: WARNING nova.compute.manager [req-2b47fa63-6589-4c4a-96cf-d3cf5d39e38f req-b82d3cca-84b0-481c-9699-ae4499a60747 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 for instance with vm_state building and task_state spawning.
Aug 14 15:03:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-55ebfcec-68c4-4080-b305-6f3131633bd1 req-a12b1b56-65cb-42c7-a736-d07f403819f6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-55ebfcec-68c4-4080-b305-6f3131633bd1 req-a12b1b56-65cb-42c7-a736-d07f403819f6 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-55ebfcec-68c4-4080-b305-6f3131633bd1 req-a12b1b56-65cb-42c7-a736-d07f403819f6 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-55ebfcec-68c4-4080-b305-6f3131633bd1 req-a12b1b56-65cb-42c7-a736-d07f403819f6 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-55ebfcec-68c4-4080-b305-6f3131633bd1 req-a12b1b56-65cb-42c7-a736-d07f403819f6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:29 user nova-compute[73254]: WARNING nova.compute.manager [req-55ebfcec-68c4-4080-b305-6f3131633bd1 req-a12b1b56-65cb-42c7-a736-d07f403819f6 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-7e8c649a-dac5-4c92-abaf-e3e18432294c for instance with vm_state building and task_state spawning.
Aug 14 15:03:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025410.1667943, 06fb12cd-0594-4480-ac26-2b30861395f6 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:30 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] VM Resumed (Lifecycle Event)
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:03:30 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Instance spawned successfully.
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:30 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025410.1711156, 06fb12cd-0594-4480-ac26-2b30861395f6 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:30 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] VM Started (Lifecycle Event)
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:30 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:03:30 user nova-compute[73254]: INFO nova.compute.manager [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Took 11.80 seconds to spawn the instance on the hypervisor.
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-ff4751b1-508e-4454-b108-ce236d1ab1d7 req-d29d3398-eea5-4116-b02b-5771f157ae02 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ff4751b1-508e-4454-b108-ce236d1ab1d7 req-d29d3398-eea5-4116-b02b-5771f157ae02 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ff4751b1-508e-4454-b108-ce236d1ab1d7 req-d29d3398-eea5-4116-b02b-5771f157ae02 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ff4751b1-508e-4454-b108-ce236d1ab1d7 req-d29d3398-eea5-4116-b02b-5771f157ae02 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-ff4751b1-508e-4454-b108-ce236d1ab1d7 req-d29d3398-eea5-4116-b02b-5771f157ae02 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:30 user nova-compute[73254]: WARNING nova.compute.manager [req-ff4751b1-508e-4454-b108-ce236d1ab1d7 req-d29d3398-eea5-4116-b02b-5771f157ae02 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 for instance with vm_state active and task_state None.
Aug 14 15:03:30 user nova-compute[73254]: INFO nova.compute.manager [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Took 48.42 seconds to build instance.
Aug 14 15:03:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e268c1c9-4680-44d1-9d29-dde1895a2461 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "06fb12cd-0594-4480-ac26-2b30861395f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 48.554s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "73803036-4ad2-42b7-8d7e-40d2a97880fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:38 user nova-compute[73254]: INFO nova.compute.manager [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Terminating instance
Aug 14 15:03:38 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-64553d7d-19b5-4564-96d3-b4bd3f425c4d req-6f7a7d83-41a9-4b8f-a4db-0ac611abcd0a service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Received event network-vif-unplugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-64553d7d-19b5-4564-96d3-b4bd3f425c4d req-6f7a7d83-41a9-4b8f-a4db-0ac611abcd0a service nova] Acquiring lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-64553d7d-19b5-4564-96d3-b4bd3f425c4d req-6f7a7d83-41a9-4b8f-a4db-0ac611abcd0a service nova] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-64553d7d-19b5-4564-96d3-b4bd3f425c4d req-6f7a7d83-41a9-4b8f-a4db-0ac611abcd0a service nova] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-64553d7d-19b5-4564-96d3-b4bd3f425c4d req-6f7a7d83-41a9-4b8f-a4db-0ac611abcd0a service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] No waiting events found dispatching network-vif-unplugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-64553d7d-19b5-4564-96d3-b4bd3f425c4d req-6f7a7d83-41a9-4b8f-a4db-0ac611abcd0a service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Received event network-vif-unplugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:39 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Instance destroyed successfully.
Aug 14 15:03:39 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lazy-loading 'resources' on Instance uuid 73803036-4ad2-42b7-8d7e-40d2a97880fe {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:01:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-443258490',display_name='tempest-VolumesAdminNegativeTest-server-443258490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-443258490',id=14,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:01:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60e4479f583d4794b615fe3e28d8ee7f',ramdisk_id='',reservation_id='r-i5dyf49o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-656235791',owner_user_name='tempest-VolumesAdminNegativeTest-656235791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:01:43Z,user_data=None,user_id='0faec8d574c343b5a9105c5224881b80',uuid=73803036-4ad2-42b7-8d7e-40d2a97880fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "address": "fa:16:3e:50:8f:73", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a6bca6-1a", "ovs_interfaceid": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converting VIF {"id": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "address": "fa:16:3e:50:8f:73", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a6bca6-1a", "ovs_interfaceid": "30a6bca6-1a5c-4615-a1b2-b88f1fc59071", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:8f:73,bridge_name='br-int',has_traffic_filtering=True,id=30a6bca6-1a5c-4615-a1b2-b88f1fc59071,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a6bca6-1a') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG os_vif [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:8f:73,bridge_name='br-int',has_traffic_filtering=True,id=30a6bca6-1a5c-4615-a1b2-b88f1fc59071,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a6bca6-1a') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30a6bca6-1a, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:39 user nova-compute[73254]: INFO os_vif [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:8f:73,bridge_name='br-int',has_traffic_filtering=True,id=30a6bca6-1a5c-4615-a1b2-b88f1fc59071,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a6bca6-1a')
Aug 14 15:03:39 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Deleting instance files /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe_del
Aug 14 15:03:39 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Deletion of /opt/stack/data/nova/instances/73803036-4ad2-42b7-8d7e-40d2a97880fe_del complete
Aug 14 15:03:39 user nova-compute[73254]: INFO nova.compute.manager [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 14 15:03:39 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:03:39 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:41 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Took 1.22 seconds to deallocate network for instance.
Aug 14 15:03:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-b0340ccc-17d6-4560-a81c-87b5b475a63c req-7b96cb81-8433-443a-b19f-b58bc63b0d8b service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Received event network-vif-plugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b0340ccc-17d6-4560-a81c-87b5b475a63c req-7b96cb81-8433-443a-b19f-b58bc63b0d8b service nova] Acquiring lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b0340ccc-17d6-4560-a81c-87b5b475a63c req-7b96cb81-8433-443a-b19f-b58bc63b0d8b service nova] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b0340ccc-17d6-4560-a81c-87b5b475a63c req-7b96cb81-8433-443a-b19f-b58bc63b0d8b service nova] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-b0340ccc-17d6-4560-a81c-87b5b475a63c req-7b96cb81-8433-443a-b19f-b58bc63b0d8b service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] No waiting events found dispatching network-vif-plugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:41 user nova-compute[73254]: WARNING nova.compute.manager [req-b0340ccc-17d6-4560-a81c-87b5b475a63c req-7b96cb81-8433-443a-b19f-b58bc63b0d8b service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Received unexpected event network-vif-plugged-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 for instance with vm_state deleted and task_state None.
Aug 14 15:03:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-b0340ccc-17d6-4560-a81c-87b5b475a63c req-7b96cb81-8433-443a-b19f-b58bc63b0d8b service nova] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Received event network-vif-deleted-30a6bca6-1a5c-4615-a1b2-b88f1fc59071 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:03:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.503s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:41 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Deleted allocations for instance 73803036-4ad2-42b7-8d7e-40d2a97880fe
Aug 14 15:03:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b141e93d-101f-4e73-abe3-4196deeaa344 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "73803036-4ad2-42b7-8d7e-40d2a97880fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.873s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:03:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:03:44 user nova-compute[73254]: INFO nova.compute.claims [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Claim successful on node user
Aug 14 15:03:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:44 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:03:44 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.479s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:03:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:03:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG nova.policy [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ca9fb4530574c44b1a3cfa6e1b90871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7879ba4750fa40cf9ee6bfb1daf85fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:03:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Creating image(s)
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "/opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "/opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.210s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.168s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk 1073741824" returned: 0 in 0.051s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Successfully created port: e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.205s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:03:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Cannot resize image /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'migration_context' on Instance uuid c3816901-3f73-4e5c-b078-a7e78d52ef3d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Ensure instance console log exists: /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.network.neutron [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Successfully updated port: e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquired lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.network.neutron [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-38516ea6-c4dd-49a6-868d-5f2336fd5b03 req-efb8b051-5bad-4820-a9aa-76b7d3eda038 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Received event network-changed-e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-38516ea6-c4dd-49a6-868d-5f2336fd5b03 req-efb8b051-5bad-4820-a9aa-76b7d3eda038 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Refreshing instance network info cache due to event network-changed-e0349c97-c31d-41dd-96ca-3fd8207d86ff. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-38516ea6-c4dd-49a6-868d-5f2336fd5b03 req-efb8b051-5bad-4820-a9aa-76b7d3eda038 service nova] Acquiring lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.network.neutron [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.network.neutron [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Updating instance_info_cache with network_info: [{"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Releasing lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Instance network_info: |[{"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-38516ea6-c4dd-49a6-868d-5f2336fd5b03 req-efb8b051-5bad-4820-a9aa-76b7d3eda038 service nova] Acquired lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.network.neutron [req-38516ea6-c4dd-49a6-868d-5f2336fd5b03 req-efb8b051-5bad-4820-a9aa-76b7d3eda038 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Refreshing network info cache for port e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Start _get_guest_xml network_info=[{"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:03:46 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:03:46 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1951994922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1951994922',id=19,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-jpqouobm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:03:45Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=c3816901-3f73-4e5c-b078-a7e78d52ef3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:b2,bridge_name='br-int',has_traffic_filtering=True,id=e0349c97-c31d-41dd-96ca-3fd8207d86ff,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0349c97-c3') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'pci_devices' on Instance uuid c3816901-3f73-4e5c-b078-a7e78d52ef3d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:03:47 user nova-compute[73254]:   <uuid>c3816901-3f73-4e5c-b078-a7e78d52ef3d</uuid>
Aug 14 15:03:47 user nova-compute[73254]:   <name>instance-00000013</name>
Aug 14 15:03:47 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:03:47 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:03:47 user nova-compute[73254]:   <metadata>
Aug 14 15:03:47 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:03:47 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:03:47 user nova-compute[73254]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1951994922</nova:name>
Aug 14 15:03:47 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:03:46</nova:creationTime>
Aug 14 15:03:47 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:03:47 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:03:47 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:03:47 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:03:47 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:03:47 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:03:47 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:03:47 user nova-compute[73254]:       <nova:owner>
Aug 14 15:03:47 user nova-compute[73254]:         <nova:user uuid="4ca9fb4530574c44b1a3cfa6e1b90871">tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member</nova:user>
Aug 14 15:03:47 user nova-compute[73254]:         <nova:project uuid="7879ba4750fa40cf9ee6bfb1daf85fdf">tempest-ServerBootFromVolumeStableRescueTest-1955280356</nova:project>
Aug 14 15:03:47 user nova-compute[73254]:       </nova:owner>
Aug 14 15:03:47 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:03:47 user nova-compute[73254]:       <nova:ports>
Aug 14 15:03:47 user nova-compute[73254]:         <nova:port uuid="e0349c97-c31d-41dd-96ca-3fd8207d86ff">
Aug 14 15:03:47 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 14 15:03:47 user nova-compute[73254]:         </nova:port>
Aug 14 15:03:47 user nova-compute[73254]:       </nova:ports>
Aug 14 15:03:47 user nova-compute[73254]:     </nova:instance>
Aug 14 15:03:47 user nova-compute[73254]:   </metadata>
Aug 14 15:03:47 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:03:47 user nova-compute[73254]:     <system>
Aug 14 15:03:47 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:03:47 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:03:47 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:03:47 user nova-compute[73254]:       <entry name="serial">c3816901-3f73-4e5c-b078-a7e78d52ef3d</entry>
Aug 14 15:03:47 user nova-compute[73254]:       <entry name="uuid">c3816901-3f73-4e5c-b078-a7e78d52ef3d</entry>
Aug 14 15:03:47 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:03:47 user nova-compute[73254]:     </system>
Aug 14 15:03:47 user nova-compute[73254]:   </sysinfo>
Aug 14 15:03:47 user nova-compute[73254]:   <os>
Aug 14 15:03:47 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:03:47 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:03:47 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:03:47 user nova-compute[73254]:   </os>
Aug 14 15:03:47 user nova-compute[73254]:   <features>
Aug 14 15:03:47 user nova-compute[73254]:     <acpi/>
Aug 14 15:03:47 user nova-compute[73254]:     <apic/>
Aug 14 15:03:47 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:03:47 user nova-compute[73254]:   </features>
Aug 14 15:03:47 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:03:47 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:03:47 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:03:47 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:03:47 user nova-compute[73254]:   </clock>
Aug 14 15:03:47 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:03:47 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:03:47 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:03:47 user nova-compute[73254]:   </cpu>
Aug 14 15:03:47 user nova-compute[73254]:   <devices>
Aug 14 15:03:47 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:03:47 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:03:47 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk"/>
Aug 14 15:03:47 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:03:47 user nova-compute[73254]:     </disk>
Aug 14 15:03:47 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:03:47 user nova-compute[73254]:       <mac address="fa:16:3e:52:f5:b2"/>
Aug 14 15:03:47 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:47 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:03:47 user nova-compute[73254]:       <target dev="tape0349c97-c3"/>
Aug 14 15:03:47 user nova-compute[73254]:     </interface>
Aug 14 15:03:47 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:03:47 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/console.log" append="off"/>
Aug 14 15:03:47 user nova-compute[73254]:     </serial>
Aug 14 15:03:47 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:03:47 user nova-compute[73254]:     <video>
Aug 14 15:03:47 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:03:47 user nova-compute[73254]:     </video>
Aug 14 15:03:47 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:03:47 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:03:47 user nova-compute[73254]:     </rng>
Aug 14 15:03:47 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:03:47 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:03:47 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:03:47 user nova-compute[73254]:     </memballoon>
Aug 14 15:03:47 user nova-compute[73254]:   </devices>
Aug 14 15:03:47 user nova-compute[73254]: </domain>
Aug 14 15:03:47 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1951994922',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1951994922',id=19,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-jpqouobm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:03:45Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=c3816901-3f73-4e5c-b078-a7e78d52ef3d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:b2,bridge_name='br-int',has_traffic_filtering=True,id=e0349c97-c31d-41dd-96ca-3fd8207d86ff,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0349c97-c3') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG os_vif [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:b2,bridge_name='br-int',has_traffic_filtering=True,id=e0349c97-c31d-41dd-96ca-3fd8207d86ff,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0349c97-c3') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0349c97-c3, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape0349c97-c3, col_values=(('external_ids', {'iface-id': 'e0349c97-c31d-41dd-96ca-3fd8207d86ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:f5:b2', 'vm-uuid': 'c3816901-3f73-4e5c-b078-a7e78d52ef3d'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:47 user nova-compute[73254]: INFO os_vif [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f5:b2,bridge_name='br-int',has_traffic_filtering=True,id=e0349c97-c31d-41dd-96ca-3fd8207d86ff,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0349c97-c3')
Aug 14 15:03:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No VIF found with MAC fa:16:3e:52:f5:b2, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-38516ea6-c4dd-49a6-868d-5f2336fd5b03 req-efb8b051-5bad-4820-a9aa-76b7d3eda038 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Updated VIF entry in instance network info cache for port e0349c97-c31d-41dd-96ca-3fd8207d86ff. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-38516ea6-c4dd-49a6-868d-5f2336fd5b03 req-efb8b051-5bad-4820-a9aa-76b7d3eda038 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Updating instance_info_cache with network_info: [{"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-38516ea6-c4dd-49a6-868d-5f2336fd5b03 req-efb8b051-5bad-4820-a9aa-76b7d3eda038 service nova] Releasing lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:03:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-bbb867b6-fc8a-4392-89a0-602d9ef826b7 req-e7581f82-a6a3-4dce-9ea4-b198f6513071 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Received event network-vif-plugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bbb867b6-fc8a-4392-89a0-602d9ef826b7 req-e7581f82-a6a3-4dce-9ea4-b198f6513071 service nova] Acquiring lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bbb867b6-fc8a-4392-89a0-602d9ef826b7 req-e7581f82-a6a3-4dce-9ea4-b198f6513071 service nova] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bbb867b6-fc8a-4392-89a0-602d9ef826b7 req-e7581f82-a6a3-4dce-9ea4-b198f6513071 service nova] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-bbb867b6-fc8a-4392-89a0-602d9ef826b7 req-e7581f82-a6a3-4dce-9ea4-b198f6513071 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] No waiting events found dispatching network-vif-plugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:49 user nova-compute[73254]: WARNING nova.compute.manager [req-bbb867b6-fc8a-4392-89a0-602d9ef826b7 req-e7581f82-a6a3-4dce-9ea4-b198f6513071 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Received unexpected event network-vif-plugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff for instance with vm_state building and task_state spawning.
Aug 14 15:03:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025430.8546357, c3816901-3f73-4e5c-b078-a7e78d52ef3d => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:50 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] VM Resumed (Lifecycle Event)
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:03:50 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Instance spawned successfully.
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:50 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025430.8588428, c3816901-3f73-4e5c-b078-a7e78d52ef3d => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:50 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] VM Started (Lifecycle Event)
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:03:50 user nova-compute[73254]: INFO nova.compute.manager [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Took 5.76 seconds to spawn the instance on the hypervisor.
Aug 14 15:03:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:50 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:03:51 user nova-compute[73254]: INFO nova.compute.manager [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Took 6.53 seconds to build instance.
Aug 14 15:03:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-53a5bc21-50ec-47e2-9aa4-84d3d529a999 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.642s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-89b66bf3-02c4-49e4-b877-d182f04239e2 req-d5578ca2-c82c-434e-969c-4e1fe94ac552 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Received event network-vif-plugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-89b66bf3-02c4-49e4-b877-d182f04239e2 req-d5578ca2-c82c-434e-969c-4e1fe94ac552 service nova] Acquiring lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-89b66bf3-02c4-49e4-b877-d182f04239e2 req-d5578ca2-c82c-434e-969c-4e1fe94ac552 service nova] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-89b66bf3-02c4-49e4-b877-d182f04239e2 req-d5578ca2-c82c-434e-969c-4e1fe94ac552 service nova] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-89b66bf3-02c4-49e4-b877-d182f04239e2 req-d5578ca2-c82c-434e-969c-4e1fe94ac552 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] No waiting events found dispatching network-vif-plugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:51 user nova-compute[73254]: WARNING nova.compute.manager [req-89b66bf3-02c4-49e4-b877-d182f04239e2 req-d5578ca2-c82c-434e-969c-4e1fe94ac552 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Received unexpected event network-vif-plugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff for instance with vm_state active and task_state None.
Aug 14 15:03:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:52 user nova-compute[73254]: INFO nova.compute.manager [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Terminating instance
Aug 14 15:03:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG nova.compute.manager [req-72de5498-c0a2-4570-9819-68d555ae2b8b req-2751bb21-b79c-47d7-ab70-0556d5f9aff5 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received event network-vif-unplugged-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72de5498-c0a2-4570-9819-68d555ae2b8b req-2751bb21-b79c-47d7-ab70-0556d5f9aff5 service nova] Acquiring lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72de5498-c0a2-4570-9819-68d555ae2b8b req-2751bb21-b79c-47d7-ab70-0556d5f9aff5 service nova] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72de5498-c0a2-4570-9819-68d555ae2b8b req-2751bb21-b79c-47d7-ab70-0556d5f9aff5 service nova] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG nova.compute.manager [req-72de5498-c0a2-4570-9819-68d555ae2b8b req-2751bb21-b79c-47d7-ab70-0556d5f9aff5 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] No waiting events found dispatching network-vif-unplugged-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG nova.compute.manager [req-72de5498-c0a2-4570-9819-68d555ae2b8b req-2751bb21-b79c-47d7-ab70-0556d5f9aff5 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received event network-vif-unplugged-76fee70f-931e-4f07-97c3-038f881fbaf3 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Instance destroyed successfully.
Aug 14 15:03:53 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lazy-loading 'resources' on Instance uuid fe35bcec-a10d-4554-8cd7-1a9d1a72f484 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1338470371',display_name='tempest-TestVolumeSwap-server-1338470371',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1338470371',id=7,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPMX8Y9HsHAZs1hjzLmSOJdmsc7A9Y/32bVj6dJpxpzOyWACcjfppcUWaULN6k3+qu+/OM+fLhf+UPoUHdJ2R0ti5bFLuN00BhE1ZrQIER3BfQVH+nZu9iLnUgDC5OqYg==',key_name='tempest-keypair-325102393',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8d45f7768d534479811ccd77e0d68e3c',ramdisk_id='',reservation_id='r-x897bu7a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-879295236',owner_user_name='tempest-TestVolumeSwap-879295236-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e9ec47f996447e9f8636a716ae6fd9',uuid=fe35bcec-a10d-4554-8cd7-1a9d1a72f484,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Converting VIF {"id": "76fee70f-931e-4f07-97c3-038f881fbaf3", "address": "fa:16:3e:20:f2:d5", "network": {"id": "0959107e-cd27-4f83-b3d6-34aeae90059a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-259606357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8d45f7768d534479811ccd77e0d68e3c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76fee70f-93", "ovs_interfaceid": "76fee70f-931e-4f07-97c3-038f881fbaf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:f2:d5,bridge_name='br-int',has_traffic_filtering=True,id=76fee70f-931e-4f07-97c3-038f881fbaf3,network=Network(0959107e-cd27-4f83-b3d6-34aeae90059a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76fee70f-93') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG os_vif [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:f2:d5,bridge_name='br-int',has_traffic_filtering=True,id=76fee70f-931e-4f07-97c3-038f881fbaf3,network=Network(0959107e-cd27-4f83-b3d6-34aeae90059a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76fee70f-93') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76fee70f-93, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:53 user nova-compute[73254]: INFO os_vif [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:f2:d5,bridge_name='br-int',has_traffic_filtering=True,id=76fee70f-931e-4f07-97c3-038f881fbaf3,network=Network(0959107e-cd27-4f83-b3d6-34aeae90059a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76fee70f-93')
Aug 14 15:03:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Deleting instance files /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484_del
Aug 14 15:03:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Deletion of /opt/stack/data/nova/instances/fe35bcec-a10d-4554-8cd7-1a9d1a72f484_del complete
Aug 14 15:03:53 user nova-compute[73254]: INFO nova.compute.manager [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 14 15:03:53 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:03:53 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:54 user nova-compute[73254]: INFO nova.compute.manager [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Detaching volume f484e8c7-e4b6-4d37-820f-7f100c848c9a
Aug 14 15:03:54 user nova-compute[73254]: INFO nova.virt.block_device [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Attempting to driver detach volume f484e8c7-e4b6-4d37-820f-7f100c848c9a from mountpoint /dev/vdc
Aug 14 15:03:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Attempting to detach device vdc from instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:03:54 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:03:54 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:03:54 user nova-compute[73254]:   <target dev="vdc" bus="virtio"/>
Aug 14 15:03:54 user nova-compute[73254]:   <serial>f484e8c7-e4b6-4d37-820f-7f100c848c9a</serial>
Aug 14 15:03:54 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 15:03:54 user nova-compute[73254]: </disk>
Aug 14 15:03:54 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:03:54 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Successfully detached device vdc from instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263 from the persistent domain config.
Aug 14 15:03:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:03:54 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:03:54 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:03:54 user nova-compute[73254]:   <target dev="vdc" bus="virtio"/>
Aug 14 15:03:54 user nova-compute[73254]:   <serial>f484e8c7-e4b6-4d37-820f-7f100c848c9a</serial>
Aug 14 15:03:54 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 15:03:54 user nova-compute[73254]: </disk>
Aug 14 15:03:54 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025434.6260114, 01e4cd7e-3fd9-47fe-870e-31fcd457e263 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:03:54 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Successfully detached device vdc from instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263 from the live domain config.
Aug 14 15:03:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FVWLNZjK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:03:54 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50c4f28-c774-4d64-8661-58002c19424d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0728b59-ff4e-4dcd-944f-93985babf255]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:54 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:54 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:54 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:54 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:03:54 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:03:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a (non-flash)
Aug 14 15:03:54 user nova-compute[73254]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:03:54 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:03:54 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:03:54 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:03:54 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:03:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd668374d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34c80ac-f8b8-4cd1-bc56-d9cefa915f6d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025419.7443566, 73803036-4ad2-42b7-8d7e-40d2a97880fe => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:03:54 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] VM Stopped (Lifecycle Event)
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[839e7109-80cf-4cf9-9fcd-36039a5d78c9]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-9196bfb9-95b8-4228-9b5a-16862faac65b None None] [instance: 73803036-4ad2-42b7-8d7e-40d2a97880fe] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadded5c-796a-4697-9d1e-5b33d9a1de01]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa331e0-b480-41f3-9d4b-1e669706d76a]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9943e36-a739-4023-9c3f-a440c794f92c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad59cc5-6a7d-42f5-826e-39ac405fe04e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a, portal: 172.16.0.220,3260]
Aug 14 15:03:54 user nova-compute[73254]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a, portal: 172.16.0.220,3260] successful.
Aug 14 15:03:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f484e8c7-e4b6-4d37-820f-7f100c848c9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4661053-11a8-44f5-ba07-355e2e42a9d7]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] <== disconnect_volume: return (334ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:03:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:55 user nova-compute[73254]: INFO nova.compute.manager [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Terminating instance
Aug 14 15:03:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:03:55 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Took 1.50 seconds to deallocate network for instance.
Aug 14 15:03:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-3b6a02bd-ed26-49a2-9cc2-33ad1d98f373 req-8796f7b0-6e97-4ef3-9f67-fa19148ac571 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received event network-vif-deleted-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:55 user nova-compute[73254]: INFO nova.compute.manager [req-3b6a02bd-ed26-49a2-9cc2-33ad1d98f373 req-8796f7b0-6e97-4ef3-9f67-fa19148ac571 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Neutron deleted interface 76fee70f-931e-4f07-97c3-038f881fbaf3; detaching it from the instance and deleting it from the info cache
Aug 14 15:03:55 user nova-compute[73254]: DEBUG nova.network.neutron [req-3b6a02bd-ed26-49a2-9cc2-33ad1d98f373 req-8796f7b0-6e97-4ef3-9f67-fa19148ac571 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-3b6a02bd-ed26-49a2-9cc2-33ad1d98f373 req-8796f7b0-6e97-4ef3-9f67-fa19148ac571 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Detach interface failed, port_id=76fee70f-931e-4f07-97c3-038f881fbaf3, reason: Instance fe35bcec-a10d-4554-8cd7-1a9d1a72f484 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-3727d831-6a77-4259-a311-2650bd676001 req-298ee7c7-1cfa-4cf4-a340-24d361ca9d22 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received event network-vif-plugged-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3727d831-6a77-4259-a311-2650bd676001 req-298ee7c7-1cfa-4cf4-a340-24d361ca9d22 service nova] Acquiring lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3727d831-6a77-4259-a311-2650bd676001 req-298ee7c7-1cfa-4cf4-a340-24d361ca9d22 service nova] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3727d831-6a77-4259-a311-2650bd676001 req-298ee7c7-1cfa-4cf4-a340-24d361ca9d22 service nova] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-3727d831-6a77-4259-a311-2650bd676001 req-298ee7c7-1cfa-4cf4-a340-24d361ca9d22 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] No waiting events found dispatching network-vif-plugged-76fee70f-931e-4f07-97c3-038f881fbaf3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:55 user nova-compute[73254]: WARNING nova.compute.manager [req-3727d831-6a77-4259-a311-2650bd676001 req-298ee7c7-1cfa-4cf4-a340-24d361ca9d22 service nova] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Received unexpected event network-vif-plugged-76fee70f-931e-4f07-97c3-038f881fbaf3 for instance with vm_state deleted and task_state None.
Aug 14 15:03:55 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'flavor' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:03:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5088e69a-1242-4873-b40e-b35a4480cdb1 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.930s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Instance destroyed successfully.
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.objects.instance [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lazy-loading 'resources' on Instance uuid 2d7ac783-716a-4c23-9466-fa7d5eae73a8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-544943482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-544943482',id=8,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcdSxFKpASTpyKhbhzDsSWv3GXJrMID1+oMw/wX47BEW8KN1RfU7r4bg37xM5MdthGSSQ9JIDbWKb/2U2KILoiTbqPHrrAmuGNudKYu3nQs30o8jYIS9Hk8qUI1/vH5qg==',key_name='tempest-keypair-273322457',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32cc73fa0a494e44b42a9271927ec303',ramdisk_id='',reservation_id='r-t6n5sxna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1515900016',owner_user_name='tempest-TaggedAttachmentsTest-1515900016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d387ffd01c7847c590051e5c685cbabf',uuid=2d7ac783-716a-4c23-9466-fa7d5eae73a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converting VIF {"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=45d7f56d-49d0-40e6-9d49-768c55a51b61,network=Network(e18bddee-e9b0-4855-8718-5ee1656987c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d7f56d-49') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG os_vif [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=45d7f56d-49d0-40e6-9d49-768c55a51b61,network=Network(e18bddee-e9b0-4855-8718-5ee1656987c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d7f56d-49') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45d7f56d-49, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:56 user nova-compute[73254]: INFO os_vif [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:2a:28,bridge_name='br-int',has_traffic_filtering=True,id=45d7f56d-49d0-40e6-9d49-768c55a51b61,network=Network(e18bddee-e9b0-4855-8718-5ee1656987c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45d7f56d-49')
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T14:58:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-544943482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-544943482',id=8,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBcdSxFKpASTpyKhbhzDsSWv3GXJrMID1+oMw/wX47BEW8KN1RfU7r4bg37xM5MdthGSSQ9JIDbWKb/2U2KILoiTbqPHrrAmuGNudKYu3nQs30o8jYIS9Hk8qUI1/vH5qg==',key_name='tempest-keypair-273322457',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='32cc73fa0a494e44b42a9271927ec303',ramdisk_id='',reservation_id='r-t6n5sxna',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1515900016',owner_user_name='tempest-TaggedAttachmentsTest-1515900016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:58:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d387ffd01c7847c590051e5c685cbabf',uuid=2d7ac783-716a-4c23-9466-fa7d5eae73a8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "address": "fa:16:3e:9a:5e:f2", "network": {"id": "e663ce28-72a4-40a2-8d20-d5fd53e24860", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1742618993", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac2403d-b1", "ovs_interfaceid": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converting VIF {"id": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "address": "fa:16:3e:9a:5e:f2", "network": {"id": "e663ce28-72a4-40a2-8d20-d5fd53e24860", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1742618993", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac2403d-b1", "ovs_interfaceid": "6ac2403d-b18f-4335-b2e3-bebe706ba776", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:f2,bridge_name='br-int',has_traffic_filtering=True,id=6ac2403d-b18f-4335-b2e3-bebe706ba776,network=Network(e663ce28-72a4-40a2-8d20-d5fd53e24860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac2403d-b1') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG os_vif [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:f2,bridge_name='br-int',has_traffic_filtering=True,id=6ac2403d-b18f-4335-b2e3-bebe706ba776,network=Network(e663ce28-72a4-40a2-8d20-d5fd53e24860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac2403d-b1') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ac2403d-b1, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.955s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:56 user nova-compute[73254]: INFO os_vif [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:f2,bridge_name='br-int',has_traffic_filtering=True,id=6ac2403d-b18f-4335-b2e3-bebe706ba776,network=Network(e663ce28-72a4-40a2-8d20-d5fd53e24860),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac2403d-b1')
Aug 14 15:03:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Deleting instance files /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8_del
Aug 14 15:03:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Deletion of /opt/stack/data/nova/instances/2d7ac783-716a-4c23-9466-fa7d5eae73a8_del complete
Aug 14 15:03:56 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Deleted allocations for instance fe35bcec-a10d-4554-8cd7-1a9d1a72f484
Aug 14 15:03:56 user nova-compute[73254]: INFO nova.compute.manager [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Took 1.12 seconds to destroy the instance on the hypervisor.
Aug 14 15:03:56 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b553f572-2469-4e60-949d-df4dd60bf375 tempest-TestVolumeSwap-879295236 tempest-TestVolumeSwap-879295236-project-member] Lock "fe35bcec-a10d-4554-8cd7-1a9d1a72f484" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.901s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-8655edd1-6157-4ec2-86a5-2abf3bb81ad6 req-a7d756c7-9b5c-4672-bb94-f70ee9a3ac62 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-vif-unplugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8655edd1-6157-4ec2-86a5-2abf3bb81ad6 req-a7d756c7-9b5c-4672-bb94-f70ee9a3ac62 service nova] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8655edd1-6157-4ec2-86a5-2abf3bb81ad6 req-a7d756c7-9b5c-4672-bb94-f70ee9a3ac62 service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8655edd1-6157-4ec2-86a5-2abf3bb81ad6 req-a7d756c7-9b5c-4672-bb94-f70ee9a3ac62 service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-8655edd1-6157-4ec2-86a5-2abf3bb81ad6 req-a7d756c7-9b5c-4672-bb94-f70ee9a3ac62 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] No waiting events found dispatching network-vif-unplugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-8655edd1-6157-4ec2-86a5-2abf3bb81ad6 req-a7d756c7-9b5c-4672-bb94-f70ee9a3ac62 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-vif-unplugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:03:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:03:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-3448732e-2918-4a5c-8c2c-e60fc711a099 req-83a5e17c-165a-4ccc-a735-e0432c387be7 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-vif-deleted-6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:57 user nova-compute[73254]: INFO nova.compute.manager [req-3448732e-2918-4a5c-8c2c-e60fc711a099 req-83a5e17c-165a-4ccc-a735-e0432c387be7 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Neutron deleted interface 6ac2403d-b18f-4335-b2e3-bebe706ba776; detaching it from the instance and deleting it from the info cache
Aug 14 15:03:57 user nova-compute[73254]: DEBUG nova.network.neutron [req-3448732e-2918-4a5c-8c2c-e60fc711a099 req-83a5e17c-165a-4ccc-a735-e0432c387be7 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updating instance_info_cache with network_info: [{"id": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "address": "fa:16:3e:01:2a:28", "network": {"id": "e18bddee-e9b0-4855-8718-5ee1656987c4", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-322826420-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "32cc73fa0a494e44b42a9271927ec303", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap45d7f56d-49", "ovs_interfaceid": "45d7f56d-49d0-40e6-9d49-768c55a51b61", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:03:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:03:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:03:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-3448732e-2918-4a5c-8c2c-e60fc711a099 req-83a5e17c-165a-4ccc-a735-e0432c387be7 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Detach interface failed, port_id=6ac2403d-b18f-4335-b2e3-bebe706ba776, reason: Instance 2d7ac783-716a-4c23-9466-fa7d5eae73a8 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:03:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:57 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:03:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:03:58 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Took 1.92 seconds to deallocate network for instance.
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-af92cb1b-c8e2-480f-b19a-d44d08625dc8 req-852c50b0-1dc6-4cd2-b956-1baad0583f7d service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-vif-plugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-af92cb1b-c8e2-480f-b19a-d44d08625dc8 req-852c50b0-1dc6-4cd2-b956-1baad0583f7d service nova] Acquiring lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-af92cb1b-c8e2-480f-b19a-d44d08625dc8 req-852c50b0-1dc6-4cd2-b956-1baad0583f7d service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-af92cb1b-c8e2-480f-b19a-d44d08625dc8 req-852c50b0-1dc6-4cd2-b956-1baad0583f7d service nova] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-af92cb1b-c8e2-480f-b19a-d44d08625dc8 req-852c50b0-1dc6-4cd2-b956-1baad0583f7d service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] No waiting events found dispatching network-vif-plugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:03:58 user nova-compute[73254]: WARNING nova.compute.manager [req-af92cb1b-c8e2-480f-b19a-d44d08625dc8 req-852c50b0-1dc6-4cd2-b956-1baad0583f7d service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received unexpected event network-vif-plugged-6ac2403d-b18f-4335-b2e3-bebe706ba776 for instance with vm_state deleted and task_state None.
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:58 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.578s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:59 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Deleted allocations for instance 2d7ac783-716a-4c23-9466-fa7d5eae73a8
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-59b8c167-2fd0-49af-bf36-099675861e7f tempest-TaggedAttachmentsTest-1515900016 tempest-TaggedAttachmentsTest-1515900016-project-member] Lock "2d7ac783-716a-4c23-9466-fa7d5eae73a8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.844s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-6799867e-78f9-4a79-87b9-cc9f74520e3c req-3cfe992d-5d7e-4e84-8c96-8efc668e0e93 service nova] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Received event network-vif-deleted-45d7f56d-49d0-40e6-9d49-768c55a51b61 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:03:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:02 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:04:02 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=6902MB free_disk=25.316967010498047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Applying migration context for instance 0110dafc-b336-45bd-aade-0eb9ba632a05 as it has an incoming, in-progress migration 8c8f7735-76f7-4cdc-afeb-42761e7e9014. Migration status is finished {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 15:04:02 user nova-compute[73254]: INFO nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating resource usage from migration 8c8f7735-76f7-4cdc-afeb-42761e7e9014
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 16996b6c-6d6e-4b51-88f3-0ca024e95639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance da915cb7-8ab5-4c65-928f-70e94811dd4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Migration 8c8f7735-76f7-4cdc-afeb-42761e7e9014 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0110dafc-b336-45bd-aade-0eb9ba632a05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 06fb12cd-0594-4480-ac26-2b30861395f6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 83808001-6b81-4479-86ff-94bb588d22fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:04:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:04:03 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:04:03 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:04:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:04:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.735s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:04:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:04:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:04:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG nova.network.neutron [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Port 5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 binding to destination host user is already ACTIVE {{(pid=73254) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquired lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG nova.network.neutron [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:04:05 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG nova.network.neutron [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance_info_cache with network_info: [{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Releasing lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Creating tmpfile /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/tmpidu6uyvz to verify with other compute node that the instance is on the same shared storage. {{(pid=73254) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:06 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance destroyed successfully.
Aug 14 15:04:06 user nova-compute[73254]: DEBUG nova.objects.instance [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'resources' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1755851336',display_name='tempest-ServerActionsTestOtherB-server-1755851336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1755851336',id=2,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpJqshf7dgOYCNb3XdGQKDGpgxinwrIHq7RhTsMWSm+s6EZD5PqStn0mS7XZys0yosnUZjjjacxB+uA7VCgltNQhd/8n8Kmf9j/njpDibTqPOQpZxcFfHs+Tu7LtgV0vQ==',key_name='tempest-keypair-50791975',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:02:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7efec9b494b419d88e619898e61108c',ramdisk_id='',reservation_id='r-raqid4hj',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-872428687',owner_user_name='tempest-ServerActionsTestOtherB-872428687-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:02:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02901b088217434eb2a8a4f914ac3e18',uuid=0110dafc-b336-45bd-aade-0eb9ba632a05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converting VIF {"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG os_vif [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ce5ac2e-ae, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:06 user nova-compute[73254]: INFO os_vif [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae')
Aug 14 15:04:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:04:06 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:04:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d157e230-9a23-4f30-82bd-2281b687f16b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a716bc-3f31-4b78-9357-c827d2cbbba3]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:06 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:06 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:04:06 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:04:06 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:06 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:06 user nova-compute[73254]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:06 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:04:06 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:04:06 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:06 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64847f7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'): ({'sde'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Removing single pathed devices sde {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:04:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8dbc6e-ed8a-4dda-ba5b-b6bb42d83f20]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbc5e78-45de-4ddd-9e48-4573b64319f4]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Flushing IO for device /dev/sde {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0ea973-89eb-447b-bac2-cc3fc8248590]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0fee9cf-039f-4f43-ac7b-5a996c646543]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] SCSI volumes sde have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a25252-0028-4c53-98ad-bc55a732bca5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[63faa351-7f63-4089-8458-acb7bce3cd33]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]
Aug 14 15:04:07 user nova-compute[73254]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.
Aug 14 15:04:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af29f8-8c75-43be-a009-32e146655223]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] <== disconnect_volume: return (296ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:04:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:04:08 user nova-compute[73254]: INFO nova.compute.claims [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Claim successful on node user
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.476s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.446s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.objects.instance [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'migration_context' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.network.neutron [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:04:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025433.7376034, fe35bcec-a10d-4554-8cd7-1a9d1a72f484 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:08 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] VM Stopped (Lifecycle Event)
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5aefdf12-6c31-492a-9e12-bedf372e15fd None None] [instance: fe35bcec-a10d-4554-8cd7-1a9d1a72f484] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.policy [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ed857ef39da84f6bb3b366468512bad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a52f6944d42c083829538f3bc1016', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:04:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Creating image(s)
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "/opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "/opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "/opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.607s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.185s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk 1073741824" returned: 0 in 0.056s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.network.neutron [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Successfully created port: ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Checking if we can resize image /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:09 user nova-compute[73254]: INFO nova.compute.manager [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Swapping old allocation on dict_keys(['18d9725d-e260-4cf1-bc72-a3b274e87bc7']) held by migration 8c8f7735-76f7-4cdc-afeb-42761e7e9014 for instance
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Overwriting current allocation {'allocations': {'18d9725d-e260-4cf1-bc72-a3b274e87bc7': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 25}}, 'project_id': 'b7efec9b494b419d88e619898e61108c', 'user_id': '02901b088217434eb2a8a4f914ac3e18', 'consumer_generation': 1} on consumer 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Cannot resize image /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.objects.instance [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lazy-loading 'migration_context' on Instance uuid 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Ensure instance console log exists: /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquired lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.network.neutron [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-5c9d8c5d-4a22-4fe9-8020-95f94803762e req-60e7b26e-88c6-453e-8640-2a8064219f4b service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-unplugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5c9d8c5d-4a22-4fe9-8020-95f94803762e req-60e7b26e-88c6-453e-8640-2a8064219f4b service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5c9d8c5d-4a22-4fe9-8020-95f94803762e req-60e7b26e-88c6-453e-8640-2a8064219f4b service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5c9d8c5d-4a22-4fe9-8020-95f94803762e req-60e7b26e-88c6-453e-8640-2a8064219f4b service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-5c9d8c5d-4a22-4fe9-8020-95f94803762e req-60e7b26e-88c6-453e-8640-2a8064219f4b service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-unplugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:09 user nova-compute[73254]: WARNING nova.compute.manager [req-5c9d8c5d-4a22-4fe9-8020-95f94803762e req-60e7b26e-88c6-453e-8640-2a8064219f4b service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-unplugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state resized and task_state resize_reverting.
Aug 14 15:04:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance_info_cache with network_info: [{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Releasing lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG os_brick.utils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Successfully updated port: ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[66061465-3add-485a-9b97-8b99d40825e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb295721-2906-40fc-97c9-c24a91821fcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-73d655c7-7a31-4771-bb8e-167e3ffc477c req-546ab624-c55e-4cf3-958e-7fa09b4fa94b service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received event network-changed-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-73d655c7-7a31-4771-bb8e-167e3ffc477c req-546ab624-c55e-4cf3-958e-7fa09b4fa94b service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Refreshing instance network info cache due to event network-changed-ff00cec3-b5d9-4058-ae5b-bbe4087333e9. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-73d655c7-7a31-4771-bb8e-167e3ffc477c req-546ab624-c55e-4cf3-958e-7fa09b4fa94b service nova] Acquiring lock "refresh_cache-714586d7-babb-49e0-b2bd-e07cf4f47849" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-73d655c7-7a31-4771-bb8e-167e3ffc477c req-546ab624-c55e-4cf3-958e-7fa09b4fa94b service nova] Acquired lock "refresh_cache-714586d7-babb-49e0-b2bd-e07cf4f47849" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG nova.network.neutron [req-73d655c7-7a31-4771-bb8e-167e3ffc477c req-546ab624-c55e-4cf3-958e-7fa09b4fa94b service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Refreshing network info cache for port ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "refresh_cache-714586d7-babb-49e0-b2bd-e07cf4f47849" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:04:10 user nova-compute[73254]: DEBUG nova.network.neutron [req-73d655c7-7a31-4771-bb8e-167e3ffc477c req-546ab624-c55e-4cf3-958e-7fa09b4fa94b service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.083s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eec44a3-2d9a-4227-89f3-0dc272b62e69]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4f4e92-7aec-4ebf-a96e-0468cbd760e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:04:11 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0d1703-45e9-4fbf-a4f9-4e8a0cea361c]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG os_brick.utils [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] <== get_connector_properties: return (184ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.network.neutron [req-73d655c7-7a31-4771-bb8e-167e3ffc477c req-546ab624-c55e-4cf3-958e-7fa09b4fa94b service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-73d655c7-7a31-4771-bb8e-167e3ffc477c req-546ab624-c55e-4cf3-958e-7fa09b4fa94b service nova] Releasing lock "refresh_cache-714586d7-babb-49e0-b2bd-e07cf4f47849" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquired lock "refresh_cache-714586d7-babb-49e0-b2bd-e07cf4f47849" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025436.3234968, 2d7ac783-716a-4c23-9466-fa7d5eae73a8 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:11 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] VM Stopped (Lifecycle Event)
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-8d95d70b-146f-4770-b7e7-d58b9e9148d0 None None] [instance: 2d7ac783-716a-4c23-9466-fa7d5eae73a8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Updating instance_info_cache with network_info: [{"id": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "address": "fa:16:3e:ca:3b:92", "network": {"id": "f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-902012879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e6a52f6944d42c083829538f3bc1016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff00cec3-b5", "ovs_interfaceid": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Releasing lock "refresh_cache-714586d7-babb-49e0-b2bd-e07cf4f47849" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Instance network_info: |[{"id": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "address": "fa:16:3e:ca:3b:92", "network": {"id": "f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-902012879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e6a52f6944d42c083829538f3bc1016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff00cec3-b5", "ovs_interfaceid": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Start _get_guest_xml network_info=[{"id": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "address": "fa:16:3e:ca:3b:92", "network": {"id": "f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-902012879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e6a52f6944d42c083829538f3bc1016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff00cec3-b5", "ovs_interfaceid": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:04:11 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:04:11 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1943811141',display_name='tempest-TestServerVolumeAttachmentScenario-server-1943811141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1943811141',id=20,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWwuUfHA0IDJa5VwlpiNm2ko/TbdhllH10cRh7I69jvDo1RZSgQoFGYIr6DGWl5Ij46BomsDID2ZCao2NT8s27zRhjcCwmV/0Suqenu4BKbCf2jjaJbWeNwnB5pmFGZQA==',key_name='tempest-keypair-578706620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e6a52f6944d42c083829538f3bc1016',ramdisk_id='',reservation_id='r-m1alxbs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-642121780',owner_user_name='tempest-TestServerVolumeAttachmentScenario-642121780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed857ef39da84f6bb3b366468512bad8',uuid=714586d7-babb-49e0-b2bd-e07cf4f47849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "address": "fa:16:3e:ca:3b:92", "network": {"id": "f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-902012879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e6a52f6944d42c083829538f3bc1016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff00cec3-b5", "ovs_interfaceid": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Converting VIF {"id": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "address": "fa:16:3e:ca:3b:92", "network": {"id": "f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-902012879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e6a52f6944d42c083829538f3bc1016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff00cec3-b5", "ovs_interfaceid": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=ff00cec3-b5d9-4058-ae5b-bbe4087333e9,network=Network(f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff00cec3-b5') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.objects.instance [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lazy-loading 'pci_devices' on Instance uuid 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:04:11 user nova-compute[73254]:   <uuid>714586d7-babb-49e0-b2bd-e07cf4f47849</uuid>
Aug 14 15:04:11 user nova-compute[73254]:   <name>instance-00000014</name>
Aug 14 15:04:11 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:04:11 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:04:11 user nova-compute[73254]:   <metadata>
Aug 14 15:04:11 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:04:11 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:04:11 user nova-compute[73254]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1943811141</nova:name>
Aug 14 15:04:11 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:04:11</nova:creationTime>
Aug 14 15:04:11 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:04:11 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:04:11 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:04:11 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:04:11 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:04:11 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:04:11 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:04:11 user nova-compute[73254]:       <nova:owner>
Aug 14 15:04:11 user nova-compute[73254]:         <nova:user uuid="ed857ef39da84f6bb3b366468512bad8">tempest-TestServerVolumeAttachmentScenario-642121780-project-member</nova:user>
Aug 14 15:04:11 user nova-compute[73254]:         <nova:project uuid="0e6a52f6944d42c083829538f3bc1016">tempest-TestServerVolumeAttachmentScenario-642121780</nova:project>
Aug 14 15:04:11 user nova-compute[73254]:       </nova:owner>
Aug 14 15:04:11 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:04:11 user nova-compute[73254]:       <nova:ports>
Aug 14 15:04:11 user nova-compute[73254]:         <nova:port uuid="ff00cec3-b5d9-4058-ae5b-bbe4087333e9">
Aug 14 15:04:11 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 15:04:11 user nova-compute[73254]:         </nova:port>
Aug 14 15:04:11 user nova-compute[73254]:       </nova:ports>
Aug 14 15:04:11 user nova-compute[73254]:     </nova:instance>
Aug 14 15:04:11 user nova-compute[73254]:   </metadata>
Aug 14 15:04:11 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:04:11 user nova-compute[73254]:     <system>
Aug 14 15:04:11 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:04:11 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:04:11 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:04:11 user nova-compute[73254]:       <entry name="serial">714586d7-babb-49e0-b2bd-e07cf4f47849</entry>
Aug 14 15:04:11 user nova-compute[73254]:       <entry name="uuid">714586d7-babb-49e0-b2bd-e07cf4f47849</entry>
Aug 14 15:04:11 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:04:11 user nova-compute[73254]:     </system>
Aug 14 15:04:11 user nova-compute[73254]:   </sysinfo>
Aug 14 15:04:11 user nova-compute[73254]:   <os>
Aug 14 15:04:11 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:04:11 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:04:11 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:04:11 user nova-compute[73254]:   </os>
Aug 14 15:04:11 user nova-compute[73254]:   <features>
Aug 14 15:04:11 user nova-compute[73254]:     <acpi/>
Aug 14 15:04:11 user nova-compute[73254]:     <apic/>
Aug 14 15:04:11 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:04:11 user nova-compute[73254]:   </features>
Aug 14 15:04:11 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:04:11 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:04:11 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:04:11 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:04:11 user nova-compute[73254]:   </clock>
Aug 14 15:04:11 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:04:11 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:04:11 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:04:11 user nova-compute[73254]:   </cpu>
Aug 14 15:04:11 user nova-compute[73254]:   <devices>
Aug 14 15:04:11 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:04:11 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:04:11 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk"/>
Aug 14 15:04:11 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:04:11 user nova-compute[73254]:     </disk>
Aug 14 15:04:11 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:04:11 user nova-compute[73254]:       <mac address="fa:16:3e:ca:3b:92"/>
Aug 14 15:04:11 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:04:11 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:04:11 user nova-compute[73254]:       <target dev="tapff00cec3-b5"/>
Aug 14 15:04:11 user nova-compute[73254]:     </interface>
Aug 14 15:04:11 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:04:11 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/console.log" append="off"/>
Aug 14 15:04:11 user nova-compute[73254]:     </serial>
Aug 14 15:04:11 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:04:11 user nova-compute[73254]:     <video>
Aug 14 15:04:11 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:04:11 user nova-compute[73254]:     </video>
Aug 14 15:04:11 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:04:11 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:04:11 user nova-compute[73254]:     </rng>
Aug 14 15:04:11 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:04:11 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:04:11 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:04:11 user nova-compute[73254]:     </memballoon>
Aug 14 15:04:11 user nova-compute[73254]:   </devices>
Aug 14 15:04:11 user nova-compute[73254]: </domain>
Aug 14 15:04:11 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1943811141',display_name='tempest-TestServerVolumeAttachmentScenario-server-1943811141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1943811141',id=20,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWwuUfHA0IDJa5VwlpiNm2ko/TbdhllH10cRh7I69jvDo1RZSgQoFGYIr6DGWl5Ij46BomsDID2ZCao2NT8s27zRhjcCwmV/0Suqenu4BKbCf2jjaJbWeNwnB5pmFGZQA==',key_name='tempest-keypair-578706620',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e6a52f6944d42c083829538f3bc1016',ramdisk_id='',reservation_id='r-m1alxbs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-642121780',owner_user_name='tempest-TestServerVolumeAttachmentScenario-642121780-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:04:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed857ef39da84f6bb3b366468512bad8',uuid=714586d7-babb-49e0-b2bd-e07cf4f47849,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "address": "fa:16:3e:ca:3b:92", "network": {"id": "f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-902012879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e6a52f6944d42c083829538f3bc1016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff00cec3-b5", "ovs_interfaceid": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Converting VIF {"id": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "address": "fa:16:3e:ca:3b:92", "network": {"id": "f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-902012879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e6a52f6944d42c083829538f3bc1016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff00cec3-b5", "ovs_interfaceid": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=ff00cec3-b5d9-4058-ae5b-bbe4087333e9,network=Network(f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff00cec3-b5') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG os_vif [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=ff00cec3-b5d9-4058-ae5b-bbe4087333e9,network=Network(f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff00cec3-b5') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff00cec3-b5, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapff00cec3-b5, col_values=(('external_ids', {'iface-id': 'ff00cec3-b5d9-4058-ae5b-bbe4087333e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:3b:92', 'vm-uuid': '714586d7-babb-49e0-b2bd-e07cf4f47849'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:11 user nova-compute[73254]: INFO os_vif [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=ff00cec3-b5d9-4058-ae5b-bbe4087333e9,network=Network(f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff00cec3-b5')
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] No VIF found with MAC fa:16:3e:ca:3b:92, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-1ab97e3d-c1ab-46ac-ad73-3dbe2f1b94ac req-6cebc5fc-7bd9-49a7-99bf-780f2f9bfe26 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1ab97e3d-c1ab-46ac-ad73-3dbe2f1b94ac req-6cebc5fc-7bd9-49a7-99bf-780f2f9bfe26 service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1ab97e3d-c1ab-46ac-ad73-3dbe2f1b94ac req-6cebc5fc-7bd9-49a7-99bf-780f2f9bfe26 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1ab97e3d-c1ab-46ac-ad73-3dbe2f1b94ac req-6cebc5fc-7bd9-49a7-99bf-780f2f9bfe26 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-1ab97e3d-c1ab-46ac-ad73-3dbe2f1b94ac req-6cebc5fc-7bd9-49a7-99bf-780f2f9bfe26 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:11 user nova-compute[73254]: WARNING nova.compute.manager [req-1ab97e3d-c1ab-46ac-ad73-3dbe2f1b94ac req-6cebc5fc-7bd9-49a7-99bf-780f2f9bfe26 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state resized and task_state resize_reverting.
Aug 14 15:04:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received event network-vif-plugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] No waiting events found dispatching network-vif-plugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:14 user nova-compute[73254]: WARNING nova.compute.manager [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received unexpected event network-vif-plugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 for instance with vm_state building and task_state spawning.
Aug 14 15:04:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received event network-vif-plugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] No waiting events found dispatching network-vif-plugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:14 user nova-compute[73254]: WARNING nova.compute.manager [req-f764e9cf-b6c1-46fa-b89d-5ae1c4361bb7 req-9441012f-b43e-466a-bc49-a3b391c9a4df service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received unexpected event network-vif-plugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 for instance with vm_state building and task_state spawning.
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025455.7270422, 714586d7-babb-49e0-b2bd-e07cf4f47849 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:15 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] VM Resumed (Lifecycle Event)
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:04:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Instance spawned successfully.
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:04:15 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025455.72844, 714586d7-babb-49e0-b2bd-e07cf4f47849 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:15 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] VM Started (Lifecycle Event)
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:04:15 user nova-compute[73254]: INFO nova.compute.manager [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Took 6.99 seconds to spawn the instance on the hypervisor.
Aug 14 15:04:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:15 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:04:15 user nova-compute[73254]: INFO nova.compute.manager [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Took 7.83 seconds to build instance.
Aug 14 15:04:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88ebe1d3-8a8c-44b6-a892-fb738081d015 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.931s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Starting finish_revert_migration {{(pid=73254) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Start _get_guest_xml network_info=[{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f801120d-a828-432f-8e2d-7209c404350d', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '0110dafc-b336-45bd-aade-0eb9ba632a05', 'attached_at': '2023-08-14T15:04:20.000000', 'detached_at': '', 'volume_id': '79a4d0f2-5a42-41bd-bbbd-4e3eea10947b', 'serial': '79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:04:20 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:04:20 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.objects.instance [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:04:20 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:04:20 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:04:20 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[496701fe-53d5-4dfb-81a3-b6e75b48a197]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:04:20 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d62d9-c8d6-4b1d-8d24-89a73d6fd3cf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b] added
Aug 14 15:04:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd347fde-babd-4c5b-8f11-988473c6be0e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe03a74-c7df-4125-9e33-47a7fd0f2595]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IjvdWDfU {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IjvdWDfU" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc10fb8-3201-4dda-b369-c3b1d3ae6e73]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IjvdWDfU'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4531ba46-e74b-4608-807a-1bfe1b561226]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[928eb69c-3873-463d-a8ce-5e81044d5775]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[64061e5a-f381-4d17-ac6b-04c735481b8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]
Aug 14 15:04:20 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.
Aug 14 15:04:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87bd26a-377d-4afc-b6ea-6f8d66b00065]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[399aa1f7-037c-4970-bf8e-dc4774d80094]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:20 user nova-compute[73254]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:20 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d1a9d9-881f-4e3a-bc2b-7f8675b416b3]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:04:20 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '26335323934656337', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335323934656337', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1755851336',display_name='tempest-ServerActionsTestOtherB-server-1755851336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1755851336',id=2,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpJqshf7dgOYCNb3XdGQKDGpgxinwrIHq7RhTsMWSm+s6EZD5PqStn0mS7XZys0yosnUZjjjacxB+uA7VCgltNQhd/8n8Kmf9j/njpDibTqPOQpZxcFfHs+Tu7LtgV0vQ==',key_name='tempest-keypair-50791975',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:02:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7efec9b494b419d88e619898e61108c',ramdisk_id='',reservation_id='r-raqid4hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-872428687',owner_user_name='tempest-ServerActionsTestOtherB-872428687-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02901b088217434eb2a8a4f914ac3e18',uuid=0110dafc-b336-45bd-aade-0eb9ba632a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converting VIF {"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:04:21 user nova-compute[73254]:   <uuid>0110dafc-b336-45bd-aade-0eb9ba632a05</uuid>
Aug 14 15:04:21 user nova-compute[73254]:   <name>instance-00000002</name>
Aug 14 15:04:21 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:04:21 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:04:21 user nova-compute[73254]:   <metadata>
Aug 14 15:04:21 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:04:21 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:04:21 user nova-compute[73254]:       <nova:name>tempest-ServerActionsTestOtherB-server-1755851336</nova:name>
Aug 14 15:04:21 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:04:20</nova:creationTime>
Aug 14 15:04:21 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:04:21 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:04:21 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:04:21 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:04:21 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:04:21 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:04:21 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:04:21 user nova-compute[73254]:       <nova:owner>
Aug 14 15:04:21 user nova-compute[73254]:         <nova:user uuid="02901b088217434eb2a8a4f914ac3e18">tempest-ServerActionsTestOtherB-872428687-project-member</nova:user>
Aug 14 15:04:21 user nova-compute[73254]:         <nova:project uuid="b7efec9b494b419d88e619898e61108c">tempest-ServerActionsTestOtherB-872428687</nova:project>
Aug 14 15:04:21 user nova-compute[73254]:       </nova:owner>
Aug 14 15:04:21 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:04:21 user nova-compute[73254]:       <nova:ports>
Aug 14 15:04:21 user nova-compute[73254]:         <nova:port uuid="5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3">
Aug 14 15:04:21 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 15:04:21 user nova-compute[73254]:         </nova:port>
Aug 14 15:04:21 user nova-compute[73254]:       </nova:ports>
Aug 14 15:04:21 user nova-compute[73254]:     </nova:instance>
Aug 14 15:04:21 user nova-compute[73254]:   </metadata>
Aug 14 15:04:21 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:04:21 user nova-compute[73254]:     <system>
Aug 14 15:04:21 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:04:21 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:04:21 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:04:21 user nova-compute[73254]:       <entry name="serial">0110dafc-b336-45bd-aade-0eb9ba632a05</entry>
Aug 14 15:04:21 user nova-compute[73254]:       <entry name="uuid">0110dafc-b336-45bd-aade-0eb9ba632a05</entry>
Aug 14 15:04:21 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:04:21 user nova-compute[73254]:     </system>
Aug 14 15:04:21 user nova-compute[73254]:   </sysinfo>
Aug 14 15:04:21 user nova-compute[73254]:   <os>
Aug 14 15:04:21 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:04:21 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:04:21 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:04:21 user nova-compute[73254]:   </os>
Aug 14 15:04:21 user nova-compute[73254]:   <features>
Aug 14 15:04:21 user nova-compute[73254]:     <acpi/>
Aug 14 15:04:21 user nova-compute[73254]:     <apic/>
Aug 14 15:04:21 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:04:21 user nova-compute[73254]:   </features>
Aug 14 15:04:21 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:04:21 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:04:21 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:04:21 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:04:21 user nova-compute[73254]:   </clock>
Aug 14 15:04:21 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:04:21 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:04:21 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:04:21 user nova-compute[73254]:   </cpu>
Aug 14 15:04:21 user nova-compute[73254]:   <devices>
Aug 14 15:04:21 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:04:21 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:04:21 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk"/>
Aug 14 15:04:21 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:04:21 user nova-compute[73254]:     </disk>
Aug 14 15:04:21 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:04:21 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:04:21 user nova-compute[73254]:       <source dev="/dev/sdc"/>
Aug 14 15:04:21 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:04:21 user nova-compute[73254]:       <serial>79a4d0f2-5a42-41bd-bbbd-4e3eea10947b</serial>
Aug 14 15:04:21 user nova-compute[73254]:     </disk>
Aug 14 15:04:21 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:04:21 user nova-compute[73254]:       <mac address="fa:16:3e:02:af:58"/>
Aug 14 15:04:21 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:04:21 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:04:21 user nova-compute[73254]:       <target dev="tap5ce5ac2e-ae"/>
Aug 14 15:04:21 user nova-compute[73254]:     </interface>
Aug 14 15:04:21 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:04:21 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/console.log" append="off"/>
Aug 14 15:04:21 user nova-compute[73254]:     </serial>
Aug 14 15:04:21 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:04:21 user nova-compute[73254]:     <video>
Aug 14 15:04:21 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:04:21 user nova-compute[73254]:     </video>
Aug 14 15:04:21 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:04:21 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:04:21 user nova-compute[73254]:     </rng>
Aug 14 15:04:21 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:04:21 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:04:21 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:04:21 user nova-compute[73254]:     </memballoon>
Aug 14 15:04:21 user nova-compute[73254]:   </devices>
Aug 14 15:04:21 user nova-compute[73254]: </domain>
Aug 14 15:04:21 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1755851336',display_name='tempest-ServerActionsTestOtherB-server-1755851336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1755851336',id=2,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpJqshf7dgOYCNb3XdGQKDGpgxinwrIHq7RhTsMWSm+s6EZD5PqStn0mS7XZys0yosnUZjjjacxB+uA7VCgltNQhd/8n8Kmf9j/njpDibTqPOQpZxcFfHs+Tu7LtgV0vQ==',key_name='tempest-keypair-50791975',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:02:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b7efec9b494b419d88e619898e61108c',ramdisk_id='',reservation_id='r-raqid4hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-872428687',owner_user_name='tempest-ServerActionsTestOtherB-872428687-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02901b088217434eb2a8a4f914ac3e18',uuid=0110dafc-b336-45bd-aade-0eb9ba632a05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converting VIF {"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG os_vif [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ce5ac2e-ae, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ce5ac2e-ae, col_values=(('external_ids', {'iface-id': '5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:af:58', 'vm-uuid': '0110dafc-b336-45bd-aade-0eb9ba632a05'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:21 user nova-compute[73254]: INFO os_vif [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae')
Aug 14 15:04:21 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025446.8765583, 0110dafc-b336-45bd-aade-0eb9ba632a05 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:21 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] VM Stopped (Lifecycle Event)
Aug 14 15:04:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-163c0e98-d660-4e4f-bdbe-e350213831ce None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-03ffc6df-8164-4ad8-bfbf-12ed2fca0e01 req-c8799142-18c3-4034-ab00-595d0197b44c service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-03ffc6df-8164-4ad8-bfbf-12ed2fca0e01 req-c8799142-18c3-4034-ab00-595d0197b44c service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-03ffc6df-8164-4ad8-bfbf-12ed2fca0e01 req-c8799142-18c3-4034-ab00-595d0197b44c service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-03ffc6df-8164-4ad8-bfbf-12ed2fca0e01 req-c8799142-18c3-4034-ab00-595d0197b44c service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-03ffc6df-8164-4ad8-bfbf-12ed2fca0e01 req-c8799142-18c3-4034-ab00-595d0197b44c service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:23 user nova-compute[73254]: WARNING nova.compute.manager [req-03ffc6df-8164-4ad8-bfbf-12ed2fca0e01 req-c8799142-18c3-4034-ab00-595d0197b44c service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state resized and task_state resize_reverting.
Aug 14 15:04:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:25 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025465.1143496, 0110dafc-b336-45bd-aade-0eb9ba632a05 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:25 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] VM Resumed (Lifecycle Event)
Aug 14 15:04:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:04:25 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance running successfully.
Aug 14 15:04:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] finish_revert_migration finished successfully. {{(pid=73254) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 14 15:04:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:04:25 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 15:04:25 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025465.118048, 0110dafc-b336-45bd-aade-0eb9ba632a05 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:25 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] VM Started (Lifecycle Event)
Aug 14 15:04:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:04:25 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 14 15:04:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-68cc74ab-260a-4481-a8f1-c6ff74d0d708 req-07041bae-f658-4679-819a-94810d0427bc service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-68cc74ab-260a-4481-a8f1-c6ff74d0d708 req-07041bae-f658-4679-819a-94810d0427bc service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-68cc74ab-260a-4481-a8f1-c6ff74d0d708 req-07041bae-f658-4679-819a-94810d0427bc service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-68cc74ab-260a-4481-a8f1-c6ff74d0d708 req-07041bae-f658-4679-819a-94810d0427bc service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-68cc74ab-260a-4481-a8f1-c6ff74d0d708 req-07041bae-f658-4679-819a-94810d0427bc service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:25 user nova-compute[73254]: WARNING nova.compute.manager [req-68cc74ab-260a-4481-a8f1-c6ff74d0d708 req-07041bae-f658-4679-819a-94810d0427bc service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state resized and task_state resize_reverting.
Aug 14 15:04:25 user nova-compute[73254]: INFO nova.compute.manager [None req-65c5be73-6a69-474b-ba1d-a3dd251a27d2 tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance to original state: 'active'
Aug 14 15:04:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 16996b6c-6d6e-4b51-88f3-0ca024e95639 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid da915cb7-8ab5-4c65-928f-70e94811dd4e {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 4b878d88-e5f3-41b9-a399-c2da1806e1fc {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 06fb12cd-0594-4480-ac26-2b30861395f6 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 83808001-6b81-4479-86ff-94bb588d22fd {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid c3816901-3f73-4e5c-b078-a7e78d52ef3d {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "16996b6c-6d6e-4b51-88f3-0ca024e95639" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "06fb12cd-0594-4480-ac26-2b30861395f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "83808001-6b81-4479-86ff-94bb588d22fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:31 user nova-compute[73254]: WARNING oslo_messaging._drivers.amqpdriver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "06fb12cd-0594-4480-ac26-2b30861395f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "83808001-6b81-4479-86ff-94bb588d22fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-1ecfad65-0ca8-4e46-96c8-c84a6292c636 req-916587dd-50ca-4f62-8b80-398c5dcb2ebf service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-changed-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-1ecfad65-0ca8-4e46-96c8-c84a6292c636 req-916587dd-50ca-4f62-8b80-398c5dcb2ebf service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing instance network info cache due to event network-changed-6a6169be-8600-4e65-8b26-6324edf3e09b. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:04:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1ecfad65-0ca8-4e46-96c8-c84a6292c636 req-916587dd-50ca-4f62-8b80-398c5dcb2ebf service nova] Acquiring lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:04:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1ecfad65-0ca8-4e46-96c8-c84a6292c636 req-916587dd-50ca-4f62-8b80-398c5dcb2ebf service nova] Acquired lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:04:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-1ecfad65-0ca8-4e46-96c8-c84a6292c636 req-916587dd-50ca-4f62-8b80-398c5dcb2ebf service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Refreshing network info cache for port 6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:04:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-1ecfad65-0ca8-4e46-96c8-c84a6292c636 req-916587dd-50ca-4f62-8b80-398c5dcb2ebf service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updated VIF entry in instance network info cache for port 6a6169be-8600-4e65-8b26-6324edf3e09b. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:04:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-1ecfad65-0ca8-4e46-96c8-c84a6292c636 req-916587dd-50ca-4f62-8b80-398c5dcb2ebf service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [{"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1ecfad65-0ca8-4e46-96c8-c84a6292c636 req-916587dd-50ca-4f62-8b80-398c5dcb2ebf service nova] Releasing lock "refresh_cache-06fb12cd-0594-4480-ac26-2b30861395f6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "06fb12cd-0594-4480-ac26-2b30861395f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:35 user nova-compute[73254]: INFO nova.compute.manager [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Terminating instance
Aug 14 15:04:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-42f8b5e3-c9a1-46dd-a458-0df605d57f3a req-82fd2ad1-2041-403d-ad93-7a80f855fdea service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-42f8b5e3-c9a1-46dd-a458-0df605d57f3a req-82fd2ad1-2041-403d-ad93-7a80f855fdea service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-42f8b5e3-c9a1-46dd-a458-0df605d57f3a req-82fd2ad1-2041-403d-ad93-7a80f855fdea service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-42f8b5e3-c9a1-46dd-a458-0df605d57f3a req-82fd2ad1-2041-403d-ad93-7a80f855fdea service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-42f8b5e3-c9a1-46dd-a458-0df605d57f3a req-82fd2ad1-2041-403d-ad93-7a80f855fdea service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-unplugged-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-42f8b5e3-c9a1-46dd-a458-0df605d57f3a req-82fd2ad1-2041-403d-ad93-7a80f855fdea service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-6a6169be-8600-4e65-8b26-6324edf3e09b for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:35 user nova-compute[73254]: INFO nova.compute.manager [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Terminating instance
Aug 14 15:04:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-1234eece-2e09-4d4a-a17c-fdb28daec57f req-6c2b11cb-a485-4327-9030-5c2bdd7d1de9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1234eece-2e09-4d4a-a17c-fdb28daec57f req-6c2b11cb-a485-4327-9030-5c2bdd7d1de9 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1234eece-2e09-4d4a-a17c-fdb28daec57f req-6c2b11cb-a485-4327-9030-5c2bdd7d1de9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1234eece-2e09-4d4a-a17c-fdb28daec57f req-6c2b11cb-a485-4327-9030-5c2bdd7d1de9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-1234eece-2e09-4d4a-a17c-fdb28daec57f req-6c2b11cb-a485-4327-9030-5c2bdd7d1de9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-unplugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-1234eece-2e09-4d4a-a17c-fdb28daec57f req-6c2b11cb-a485-4327-9030-5c2bdd7d1de9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-e779bc58-b28b-438e-8230-98ff2c05932d req-8ae23df6-74ad-4465-b751-0eb9a6c612ec service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e779bc58-b28b-438e-8230-98ff2c05932d req-8ae23df6-74ad-4465-b751-0eb9a6c612ec service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e779bc58-b28b-438e-8230-98ff2c05932d req-8ae23df6-74ad-4465-b751-0eb9a6c612ec service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e779bc58-b28b-438e-8230-98ff2c05932d req-8ae23df6-74ad-4465-b751-0eb9a6c612ec service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-e779bc58-b28b-438e-8230-98ff2c05932d req-8ae23df6-74ad-4465-b751-0eb9a6c612ec service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-unplugged-7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-e779bc58-b28b-438e-8230-98ff2c05932d req-8ae23df6-74ad-4465-b751-0eb9a6c612ec service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-7e8c649a-dac5-4c92-abaf-e3e18432294c for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Instance destroyed successfully.
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lazy-loading 'resources' on Instance uuid da915cb7-8ab5-4c65-928f-70e94811dd4e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-289777810',display_name='tempest-VolumesAdminNegativeTest-server-289777810',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-289777810',id=6,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMvmCmDreH4NdwkDp0cxqi0jBy+Pq38S82XljegxGcgZMit83jWB+wD0AqIK0/FAySH4W8z1vrqf9cGfV/28jMe0rjBhF9lyP8nTfTTypMKgaYNpz6D1jC0o9YBQobPbg==',key_name='tempest-keypair-2047795832',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60e4479f583d4794b615fe3e28d8ee7f',ramdisk_id='',reservation_id='r-0ub9wjq8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-656235791',owner_user_name='tempest-VolumesAdminNegativeTest-656235791-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:58:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0faec8d574c343b5a9105c5224881b80',uuid=da915cb7-8ab5-4c65-928f-70e94811dd4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converting VIF {"id": "fd587446-7efc-479b-ba55-a4f56918b88d", "address": "fa:16:3e:c2:81:06", "network": {"id": "e7bf8ea5-becf-4cfb-9b34-9af27b85a81f", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1234230855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60e4479f583d4794b615fe3e28d8ee7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd587446-7e", "ovs_interfaceid": "fd587446-7efc-479b-ba55-a4f56918b88d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:81:06,bridge_name='br-int',has_traffic_filtering=True,id=fd587446-7efc-479b-ba55-a4f56918b88d,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd587446-7e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_vif [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:81:06,bridge_name='br-int',has_traffic_filtering=True,id=fd587446-7efc-479b-ba55-a4f56918b88d,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd587446-7e') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd587446-7e, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: INFO os_vif [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:81:06,bridge_name='br-int',has_traffic_filtering=True,id=fd587446-7efc-479b-ba55-a4f56918b88d,network=Network(e7bf8ea5-becf-4cfb-9b34-9af27b85a81f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd587446-7e')
Aug 14 15:04:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Deleting instance files /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e_del
Aug 14 15:04:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Deletion of /opt/stack/data/nova/instances/da915cb7-8ab5-4c65-928f-70e94811dd4e_del complete
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: INFO nova.compute.manager [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Took 1.49 seconds to destroy the instance on the hypervisor.
Aug 14 15:04:37 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:04:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Instance destroyed successfully.
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lazy-loading 'resources' on Instance uuid 06fb12cd-0594-4480-ac26-2b30861395f6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a1:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a6169be-8600-4e65-8b26-6324edf3e09b,network=Network(ccddfc19-cc5b-4090-98b9-1cfac0f137e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6169be-86') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a1:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a6169be-8600-4e65-8b26-6324edf3e09b,network=Network(ccddfc19-cc5b-4090-98b9-1cfac0f137e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6169be-86') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a6169be-86, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: INFO os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:a1:eb,bridge_name='br-int',has_traffic_filtering=True,id=6a6169be-8600-4e65-8b26-6324edf3e09b,network=Network(ccddfc19-cc5b-4090-98b9-1cfac0f137e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a6169be-86')
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d8:96,bridge_name='br-int',has_traffic_filtering=True,id=c270397e-5814-41e1-b5ed-4f39de1c5e72,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc270397e-58') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d8:96,bridge_name='br-int',has_traffic_filtering=True,id=c270397e-5814-41e1-b5ed-4f39de1c5e72,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc270397e-58') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc270397e-58, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: INFO os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:d8:96,bridge_name='br-int',has_traffic_filtering=True,id=c270397e-5814-41e1-b5ed-4f39de1c5e72,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc270397e-58')
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:00,bridge_name='br-int',has_traffic_filtering=True,id=44883790-f1ca-4d2b-b347-3f6b61a5f113,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44883790-f1') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:00,bridge_name='br-int',has_traffic_filtering=True,id=44883790-f1ca-4d2b-b347-3f6b61a5f113,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44883790-f1') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44883790-f1, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: INFO os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:5a:00,bridge_name='br-int',has_traffic_filtering=True,id=44883790-f1ca-4d2b-b347-3f6b61a5f113,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44883790-f1')
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:9c:00,bridge_name='br-int',has_traffic_filtering=True,id=4749498e-03d4-43ae-94e8-8b511f541730,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4749498e-03') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9c:00,bridge_name='br-int',has_traffic_filtering=True,id=4749498e-03d4-43ae-94e8-8b511f541730,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4749498e-03') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4749498e-03, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: INFO os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:9c:00,bridge_name='br-int',has_traffic_filtering=True,id=4749498e-03d4-43ae-94e8-8b511f541730,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4749498e-03')
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6f:27,bridge_name='br-int',has_traffic_filtering=True,id=7e8c649a-dac5-4c92-abaf-e3e18432294c,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c649a-da') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6f:27,bridge_name='br-int',has_traffic_filtering=True,id=7e8c649a-dac5-4c92-abaf-e3e18432294c,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c649a-da') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e8c649a-da, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: INFO os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:6f:27,bridge_name='br-int',has_traffic_filtering=True,id=7e8c649a-dac5-4c92-abaf-e3e18432294c,network=Network(e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e8c649a-da')
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:85:c7,bridge_name='br-int',has_traffic_filtering=True,id=e9bdf96e-8005-4693-9397-e17341995579,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bdf96e-80') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:85:c7,bridge_name='br-int',has_traffic_filtering=True,id=e9bdf96e-8005-4693-9397-e17341995579,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bdf96e-80') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9bdf96e-80, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: INFO os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:85:c7,bridge_name='br-int',has_traffic_filtering=True,id=e9bdf96e-8005-4693-9397-e17341995579,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9bdf96e-80')
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-14T15:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-885563793',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-885563793',id=15,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4Md6sTZsgJ/xrGDDB7ajjdl9Yf3AILVrTJMV6kBk5G4OnisXe84xwLavE3P1bQdSMhARIsEwyaD0LHwASzJ6kIYQhKjdUnsk4U4E3vKLgH3Xz13hczPWT9ksAanOUJ5A==',key_name='tempest-keypair-308378612',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='47c7b8d6f369479c8e42326b58efdef5',ramdisk_id='',reservation_id='r-6lt2aiux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-555544937',owner_user_name='tempest-TaggedBootDevicesTest_v242-555544937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6ef72f44e2ac4160aa748eb4d7cb8393',uuid=06fb12cd-0594-4480-ac26-2b30861395f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converting VIF {"id": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "address": "fa:16:3e:24:63:57", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aef43ab-d7", "ovs_interfaceid": "2aef43ab-d7ea-4775-a4bf-5bebce09ea29", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:63:57,bridge_name='br-int',has_traffic_filtering=True,id=2aef43ab-d7ea-4775-a4bf-5bebce09ea29,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aef43ab-d7') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:63:57,bridge_name='br-int',has_traffic_filtering=True,id=2aef43ab-d7ea-4775-a4bf-5bebce09ea29,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aef43ab-d7') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2aef43ab-d7, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:37 user nova-compute[73254]: INFO os_vif [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:63:57,bridge_name='br-int',has_traffic_filtering=True,id=2aef43ab-d7ea-4775-a4bf-5bebce09ea29,network=Network(22847617-ec79-4581-a6ee-6ad5165e6ef0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aef43ab-d7')
Aug 14 15:04:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bRJGYAoO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:04:37 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5dcf02-37a1-46f4-bb89-ae6cb6cc652d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fb1324-954d-42c6-8c37-e048262d66b6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6684ee7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7'): ({'sdd'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Removing single pathed devices sdd {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: WARNING nova.compute.manager [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-6a6169be-8600-4e65-8b26-6324edf3e09b for instance with vm_state active and task_state deleting.
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-unplugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: WARNING nova.compute.manager [req-fbb7ffd0-3ed3-458c-92f7-2d0beb95fdd3 req-05210f23-4a1d-4c87-9132-50bc70d650b3 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-44883790-f1ca-4d2b-b347-3f6b61a5f113 for instance with vm_state active and task_state deleting.
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[497977a2-8117-408e-be67-431ef502fd8e]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ffa2d0-094a-4ed4-88a0-43cabaca2b96]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Flushing IO for device /dev/sdd {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34208c7-025b-43c6-83e4-8a9bddde60ee]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.071s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2010a028-0dd2-435e-873c-824734ef755f]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8474e4-d2b1-4f2a-a42d-16582542a4e7]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eca81f-aed3-4764-9c0b-747f84dc066a]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7, portal: 172.16.0.220,3260]
Aug 14 15:04:38 user nova-compute[73254]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7, portal: 172.16.0.220,3260] successful.
Aug 14 15:04:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d35b10ca-0ded-44c2-8b0b-bee1a97846b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.047s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[633c036f-ee42-440c-bc90-fed23f9f3d1b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.557s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] <== disconnect_volume: return (558ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hdTGDpbj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:04:38 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e0aa4-534e-4fe9-97d9-9bf929cc9036]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: WARNING nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-c270397e-5814-41e1-b5ed-4f39de1c5e72 for instance with vm_state active and task_state deleting.
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-unplugged-4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-4749498e-03d4-43ae-94e8-8b511f541730 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: WARNING nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-4749498e-03d4-43ae-94e8-8b511f541730 for instance with vm_state active and task_state deleting.
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received event network-vif-unplugged-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] No waiting events found dispatching network-vif-unplugged-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received event network-vif-unplugged-fd587446-7efc-479b-ba55-a4f56918b88d for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received event network-vif-plugged-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Acquiring lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] No waiting events found dispatching network-vif-plugged-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: WARNING nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received unexpected event network-vif-plugged-fd587446-7efc-479b-ba55-a4f56918b88d for instance with vm_state active and task_state deleting.
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-unplugged-e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-e9bdf96e-8005-4693-9397-e17341995579 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: WARNING nova.compute.manager [req-c8faf620-7580-43f1-903a-3e73ec5f6158 req-79d8b1af-4408-43de-9d7e-adcf837f76d9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-e9bdf96e-8005-4693-9397-e17341995579 for instance with vm_state active and task_state deleting.
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e59501-f0fe-422a-863b-a78339c101ab]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64847c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e'): ({'sdf'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Removing single pathed devices sdf {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[56dcfa58-d048-4536-8080-d5a632e516a4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[14cf0cf3-0aba-4b47-9569-cd3623dd4272]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Flushing IO for device /dev/sdf {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3d7fb4-46dc-4e8f-9d24-952237450e62]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f04d9c-208d-4181-8cf4-0919a1fc9338]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] SCSI volumes sdf have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[30606443-56ab-4a5b-a8d0-af49cbfb049d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Took 1.28 seconds to deallocate network for instance.
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-30cb7f0f-cd6a-43d9-8b1e-bd9bd609fc7d req-7fd3ef39-6e89-40d9-b3e1-8f33801698c1 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-30cb7f0f-cd6a-43d9-8b1e-bd9bd609fc7d req-7fd3ef39-6e89-40d9-b3e1-8f33801698c1 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-30cb7f0f-cd6a-43d9-8b1e-bd9bd609fc7d req-7fd3ef39-6e89-40d9-b3e1-8f33801698c1 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-30cb7f0f-cd6a-43d9-8b1e-bd9bd609fc7d req-7fd3ef39-6e89-40d9-b3e1-8f33801698c1 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-30cb7f0f-cd6a-43d9-8b1e-bd9bd609fc7d req-7fd3ef39-6e89-40d9-b3e1-8f33801698c1 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:38 user nova-compute[73254]: WARNING nova.compute.manager [req-30cb7f0f-cd6a-43d9-8b1e-bd9bd609fc7d req-7fd3ef39-6e89-40d9-b3e1-8f33801698c1 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-7e8c649a-dac5-4c92-abaf-e3e18432294c for instance with vm_state active and task_state deleting.
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbad78f-489f-4d7d-85fc-9dc62f5a6973]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e, portal: 172.16.0.220,3260]
Aug 14 15:04:38 user nova-compute[73254]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e, portal: 172.16.0.220,3260] successful.
Aug 14 15:04:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5407c0ea-ce29-4489-b1c6-785a2630b26e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b3a620-1300-4aa5-ab6c-1db4621f9896]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] <== disconnect_volume: return (377ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zslPKUSR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:04:38 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d742946-8e8c-42f9-a141-ea24db3b22ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae4ea99-9e11-4931-9b54-15c36a9f911d]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 (non-flash)
Aug 14 15:04:38 user nova-compute[73254]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64847f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202'): ({'sdg'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Removing single pathed devices sdg {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7051f0b0-5294-496e-a307-dd16edbcc676]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa41934-1d41-4fde-b72d-2f963110c761]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Flushing IO for device /dev/sdg {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ac7f41-256c-4c0c-870b-e0495316d994]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:04:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[731e91a7-cb8a-4f93-a727-924f87693e1d]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] SCSI volumes sdg have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c7c4ed-a343-4da6-ac55-76e78f8a7f68]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff345605-97fe-4a8f-9e90-2e49b60844f2]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202, portal: 172.16.0.220,3260]
Aug 14 15:04:39 user nova-compute[73254]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202, portal: 172.16.0.220,3260] successful.
Aug 14 15:04:39 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8abd2bcb-8c17-4f10-8248-b5eeb4e18202 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc7e0fc-ed09-4106-bf2b-a33e14402c3d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] <== disconnect_volume: return (320ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:04:39 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Deleting instance files /opt/stack/data/nova/instances/06fb12cd-0594-4480-ac26-2b30861395f6_del
Aug 14 15:04:39 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Deletion of /opt/stack/data/nova/instances/06fb12cd-0594-4480-ac26-2b30861395f6_del complete
Aug 14 15:04:39 user nova-compute[73254]: INFO nova.compute.manager [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Took 3.76 seconds to destroy the instance on the hypervisor.
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.629s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:39 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Deleted allocations for instance da915cb7-8ab5-4c65-928f-70e94811dd4e
Aug 14 15:04:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b25e5523-97e4-4315-a887-21ca370ddf98 tempest-VolumesAdminNegativeTest-656235791 tempest-VolumesAdminNegativeTest-656235791-project-member] Lock "da915cb7-8ab5-4c65-928f-70e94811dd4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.637s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-fdf77bee-a0e3-44aa-b724-2adc2f7f08a4 req-7691b504-0df2-46b1-a89f-cbdff43e94bf service nova] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Received event network-vif-deleted-fd587446-7efc-479b-ba55-a4f56918b88d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-unplugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-unplugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-plugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] Acquiring lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] Lock "06fb12cd-0594-4480-ac26-2b30861395f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] No waiting events found dispatching network-vif-plugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:40 user nova-compute[73254]: WARNING nova.compute.manager [req-d7b22594-a1fa-4c1d-ad1b-181109ad60d8 req-7ce010cd-c035-4c78-829e-889e8806e982 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received unexpected event network-vif-plugged-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 for instance with vm_state active and task_state deleting.
Aug 14 15:04:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b91a42c-6bb0-41c9-8e3a-92f993809b42 req-2f2df571-86e1-41d3-8760-723b870a1e5f service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-deleted-2aef43ab-d7ea-4775-a4bf-5bebce09ea29 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:42 user nova-compute[73254]: INFO nova.compute.manager [req-9b91a42c-6bb0-41c9-8e3a-92f993809b42 req-2f2df571-86e1-41d3-8760-723b870a1e5f service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Neutron deleted interface 2aef43ab-d7ea-4775-a4bf-5bebce09ea29; detaching it from the instance and deleting it from the info cache
Aug 14 15:04:42 user nova-compute[73254]: DEBUG nova.network.neutron [req-9b91a42c-6bb0-41c9-8e3a-92f993809b42 req-2f2df571-86e1-41d3-8760-723b870a1e5f service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [{"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4749498e-03d4-43ae-94e8-8b511f541730", "address": "fa:16:3e:72:9c:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.143", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4749498e-03", "ovs_interfaceid": "4749498e-03d4-43ae-94e8-8b511f541730", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b91a42c-6bb0-41c9-8e3a-92f993809b42 req-2f2df571-86e1-41d3-8760-723b870a1e5f service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Detach interface failed, port_id=2aef43ab-d7ea-4775-a4bf-5bebce09ea29, reason: Instance 06fb12cd-0594-4480-ac26-2b30861395f6 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:04:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b91a42c-6bb0-41c9-8e3a-92f993809b42 req-2f2df571-86e1-41d3-8760-723b870a1e5f service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-deleted-4749498e-03d4-43ae-94e8-8b511f541730 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:42 user nova-compute[73254]: INFO nova.compute.manager [req-9b91a42c-6bb0-41c9-8e3a-92f993809b42 req-2f2df571-86e1-41d3-8760-723b870a1e5f service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Neutron deleted interface 4749498e-03d4-43ae-94e8-8b511f541730; detaching it from the instance and deleting it from the info cache
Aug 14 15:04:42 user nova-compute[73254]: DEBUG nova.network.neutron [req-9b91a42c-6bb0-41c9-8e3a-92f993809b42 req-2f2df571-86e1-41d3-8760-723b870a1e5f service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [{"id": "6a6169be-8600-4e65-8b26-6324edf3e09b", "address": "fa:16:3e:7c:a1:eb", "network": {"id": "ccddfc19-cc5b-4090-98b9-1cfac0f137e2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-989835429-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a6169be-86", "ovs_interfaceid": "6a6169be-8600-4e65-8b26-6324edf3e09b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "address": "fa:16:3e:c5:d8:96", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.145", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc270397e-58", "ovs_interfaceid": "c270397e-5814-41e1-b5ed-4f39de1c5e72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "address": "fa:16:3e:4f:5a:00", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.94", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44883790-f1", "ovs_interfaceid": "44883790-f1ca-4d2b-b347-3f6b61a5f113", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "address": "fa:16:3e:d3:6f:27", "network": {"id": "e8b2b4de-60bb-4c3e-884f-c0c55bfe63d7", "bridge": "br-int", "label": "tempest-device-tagging-net1-548923062", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e8c649a-da", "ovs_interfaceid": "7e8c649a-dac5-4c92-abaf-e3e18432294c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e9bdf96e-8005-4693-9397-e17341995579", "address": "fa:16:3e:58:85:c7", "network": {"id": "22847617-ec79-4581-a6ee-6ad5165e6ef0", "bridge": "br-int", "label": "tempest-device-tagging-net2-5056650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "47c7b8d6f369479c8e42326b58efdef5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9bdf96e-80", "ovs_interfaceid": "e9bdf96e-8005-4693-9397-e17341995579", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-9b91a42c-6bb0-41c9-8e3a-92f993809b42 req-2f2df571-86e1-41d3-8760-723b870a1e5f service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Detach interface failed, port_id=4749498e-03d4-43ae-94e8-8b511f541730, reason: Instance 06fb12cd-0594-4480-ac26-2b30861395f6 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:04:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:43 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:43 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Took 4.36 seconds to deallocate network for instance.
Aug 14 15:04:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-0ffcff43-6a66-437f-89c6-3d51d45c3498 req-b4ad11d4-e626-413c-8559-0ec0423332f9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-deleted-e9bdf96e-8005-4693-9397-e17341995579 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-0ffcff43-6a66-437f-89c6-3d51d45c3498 req-b4ad11d4-e626-413c-8559-0ec0423332f9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-deleted-7e8c649a-dac5-4c92-abaf-e3e18432294c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-0ffcff43-6a66-437f-89c6-3d51d45c3498 req-b4ad11d4-e626-413c-8559-0ec0423332f9 service nova] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Received event network-vif-deleted-6a6169be-8600-4e65-8b26-6324edf3e09b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:44 user nova-compute[73254]: INFO nova.compute.manager [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Terminating instance
Aug 14 15:04:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:45 user nova-compute[73254]: INFO nova.compute.manager [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Rescuing
Aug 14 15:04:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquired lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:04:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Instance destroyed successfully.
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'resources' on Instance uuid 01e4cd7e-3fd9-47fe-870e-31fcd457e263 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T14:58:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-996986071',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-996986071',id=3,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE81NCosY+hLSxQaT3YJdECPNmBC8K0IxTMmr5YY07y2f737ryycLfCD8u3aPgJZ2NssoC5w8RqzmFE2YN7aQNTJ2cW7URXqJqd2kVemceJPz7jm7EjYN9xNLeng+fhOiw==',key_name='tempest-keypair-23196029',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:02:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-72pyg0ff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01e4cd7e-3fd9-47fe-870e-31fcd457e263,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "address": "fa:16:3e:8d:e3:3d", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd61382b4-4d", "ovs_interfaceid": "d61382b4-4de4-4c87-af8d-1e23129c8d9c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG os_vif [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd61382b4-4d, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:04:45 user nova-compute[73254]: INFO os_vif [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e3:3d,bridge_name='br-int',has_traffic_filtering=True,id=d61382b4-4de4-4c87-af8d-1e23129c8d9c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd61382b4-4d')
Aug 14 15:04:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Deleting instance files /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263_del
Aug 14 15:04:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Deletion of /opt/stack/data/nova/instances/01e4cd7e-3fd9-47fe-870e-31fcd457e263_del complete
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-e9c7c8f7-5a05-4d07-bb97-19563c0b2085 req-e32dc4ec-461c-4375-9196-ae5760336be9 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-changed-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-e9c7c8f7-5a05-4d07-bb97-19563c0b2085 req-e32dc4ec-461c-4375-9196-ae5760336be9 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Refreshing instance network info cache due to event network-changed-54c73d11-8f49-4e16-ae68-750d0c2cea9b. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e9c7c8f7-5a05-4d07-bb97-19563c0b2085 req-e32dc4ec-461c-4375-9196-ae5760336be9 service nova] Acquiring lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e9c7c8f7-5a05-4d07-bb97-19563c0b2085 req-e32dc4ec-461c-4375-9196-ae5760336be9 service nova] Acquired lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.network.neutron [req-e9c7c8f7-5a05-4d07-bb97-19563c0b2085 req-e32dc4ec-461c-4375-9196-ae5760336be9 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Refreshing network info cache for port 54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:04:45 user nova-compute[73254]: INFO nova.compute.manager [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 14 15:04:45 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Updating instance_info_cache with network_info: [{"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Releasing lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.network.neutron [req-e9c7c8f7-5a05-4d07-bb97-19563c0b2085 req-e32dc4ec-461c-4375-9196-ae5760336be9 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updated VIF entry in instance network info cache for port 54c73d11-8f49-4e16-ae68-750d0c2cea9b. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.network.neutron [req-e9c7c8f7-5a05-4d07-bb97-19563c0b2085 req-e32dc4ec-461c-4375-9196-ae5760336be9 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updating instance_info_cache with network_info: [{"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:46 user nova-compute[73254]: INFO nova.compute.manager [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Took 2.67 seconds to detach 3 volumes for instance.
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e9c7c8f7-5a05-4d07-bb97-19563c0b2085 req-e32dc4ec-461c-4375-9196-ae5760336be9 service nova] Releasing lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:46 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Took 0.94 seconds to deallocate network for instance.
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-e3480401-b661-4c5d-86b0-9ed457439254 req-d7a1cad0-967e-4d17-86e7-7c9c53f19e9d service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-vif-deleted-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:46 user nova-compute[73254]: INFO nova.compute.manager [req-e3480401-b661-4c5d-86b0-9ed457439254 req-d7a1cad0-967e-4d17-86e7-7c9c53f19e9d service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Neutron deleted interface d61382b4-4de4-4c87-af8d-1e23129c8d9c; detaching it from the instance and deleting it from the info cache
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.network.neutron [req-e3480401-b661-4c5d-86b0-9ed457439254 req-d7a1cad0-967e-4d17-86e7-7c9c53f19e9d service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-vif-unplugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] No waiting events found dispatching network-vif-unplugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-vif-unplugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] Acquiring lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] No waiting events found dispatching network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:46 user nova-compute[73254]: WARNING nova.compute.manager [req-f97508fc-2717-4723-bfb1-62c3e44e3aeb req-13cab7b0-9b9a-4fbe-a309-a1f8c1a5b1f1 service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Received unexpected event network-vif-plugged-d61382b4-4de4-4c87-af8d-1e23129c8d9c for instance with vm_state active and task_state deleting.
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-e3480401-b661-4c5d-86b0-9ed457439254 req-d7a1cad0-967e-4d17-86e7-7c9c53f19e9d service nova] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Detach interface failed, port_id=d61382b4-4de4-4c87-af8d-1e23129c8d9c, reason: Instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:46 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Instance destroyed successfully.
Aug 14 15:04:46 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Attempting rescue
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73254) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Instance directory exists: not creating {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 15:04:46 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Creating image(s)
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'trusted_certs' on Instance uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:46 user nova-compute[73254]: INFO nova.compute.manager [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Detaching volume 5e02d324-2e59-4152-a018-d6f65bbd0932
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:04:46 user nova-compute[73254]: INFO nova.virt.block_device [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Attempting to driver detach volume 5e02d324-2e59-4152-a018-d6f65bbd0932 from mountpoint /dev/vdb
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Attempting to detach device vdb from instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:04:46 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:04:46 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:04:46 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:04:46 user nova-compute[73254]:   <serial>5e02d324-2e59-4152-a018-d6f65bbd0932</serial>
Aug 14 15:04:46 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 15:04:46 user nova-compute[73254]: </disk>
Aug 14 15:04:46 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.517s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.472s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.232s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:46 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Deleted allocations for instance 06fb12cd-0594-4480-ac26-2b30861395f6
Aug 14 15:04:46 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Successfully detached device vdb from instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 from the persistent domain config.
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:04:46 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:04:46 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:04:46 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:04:46 user nova-compute[73254]:   <serial>5e02d324-2e59-4152-a018-d6f65bbd0932</serial>
Aug 14 15:04:46 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 15:04:46 user nova-compute[73254]: </disk>
Aug 14 15:04:46 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue" returned: 0 in 0.077s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'migration_context' on Instance uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Start _get_guest_xml network_info=[{"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "vif_mac": "fa:16:3e:24:39:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:04:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'resources' on Instance uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.objects.instance [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'numa_topology' on Instance uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7c05abab-a180-4145-b3fc-9311ce08c484 tempest-TaggedBootDevicesTest_v242-555544937 tempest-TaggedBootDevicesTest_v242-555544937-project-member] Lock "06fb12cd-0594-4480-ac26-2b30861395f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.543s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:47 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:04:47 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.objects.instance [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'vcpu_model' on Instance uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1498207160',display_name='tempest-ServerRescueNegativeTestJSON-server-1498207160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1498207160',id=17,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-nidiuaun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:03:07Z,user_data=None,user_id='5200b421cc6c4e45b91f547888fb896a',uuid=52930af7-b452-4bff-a8cb-7e7859f99af6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "vif_mac": "fa:16:3e:24:39:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "vif_mac": "fa:16:3e:24:39:49"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:39:49,bridge_name='br-int',has_traffic_filtering=True,id=61ad42be-874d-4f4f-84e4-b51b6c4a208e,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ad42be-87') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.objects.instance [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'pci_devices' on Instance uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:04:47 user nova-compute[73254]:   <uuid>52930af7-b452-4bff-a8cb-7e7859f99af6</uuid>
Aug 14 15:04:47 user nova-compute[73254]:   <name>instance-00000011</name>
Aug 14 15:04:47 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:04:47 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:04:47 user nova-compute[73254]:   <metadata>
Aug 14 15:04:47 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:04:47 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:04:47 user nova-compute[73254]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1498207160</nova:name>
Aug 14 15:04:47 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:04:47</nova:creationTime>
Aug 14 15:04:47 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:04:47 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:04:47 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:04:47 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:04:47 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:04:47 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:04:47 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:04:47 user nova-compute[73254]:       <nova:owner>
Aug 14 15:04:47 user nova-compute[73254]:         <nova:user uuid="5200b421cc6c4e45b91f547888fb896a">tempest-ServerRescueNegativeTestJSON-324663021-project-member</nova:user>
Aug 14 15:04:47 user nova-compute[73254]:         <nova:project uuid="977830faf2af42dd8be28808611d8d16">tempest-ServerRescueNegativeTestJSON-324663021</nova:project>
Aug 14 15:04:47 user nova-compute[73254]:       </nova:owner>
Aug 14 15:04:47 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:04:47 user nova-compute[73254]:       <nova:ports>
Aug 14 15:04:47 user nova-compute[73254]:         <nova:port uuid="61ad42be-874d-4f4f-84e4-b51b6c4a208e">
Aug 14 15:04:47 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 15:04:47 user nova-compute[73254]:         </nova:port>
Aug 14 15:04:47 user nova-compute[73254]:       </nova:ports>
Aug 14 15:04:47 user nova-compute[73254]:     </nova:instance>
Aug 14 15:04:47 user nova-compute[73254]:   </metadata>
Aug 14 15:04:47 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:04:47 user nova-compute[73254]:     <system>
Aug 14 15:04:47 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:04:47 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:04:47 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:04:47 user nova-compute[73254]:       <entry name="serial">52930af7-b452-4bff-a8cb-7e7859f99af6</entry>
Aug 14 15:04:47 user nova-compute[73254]:       <entry name="uuid">52930af7-b452-4bff-a8cb-7e7859f99af6</entry>
Aug 14 15:04:47 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:04:47 user nova-compute[73254]:     </system>
Aug 14 15:04:47 user nova-compute[73254]:   </sysinfo>
Aug 14 15:04:47 user nova-compute[73254]:   <os>
Aug 14 15:04:47 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:04:47 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:04:47 user nova-compute[73254]:   </os>
Aug 14 15:04:47 user nova-compute[73254]:   <features>
Aug 14 15:04:47 user nova-compute[73254]:     <acpi/>
Aug 14 15:04:47 user nova-compute[73254]:     <apic/>
Aug 14 15:04:47 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:04:47 user nova-compute[73254]:   </features>
Aug 14 15:04:47 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:04:47 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:04:47 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:04:47 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:04:47 user nova-compute[73254]:   </clock>
Aug 14 15:04:47 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:04:47 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:04:47 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:04:47 user nova-compute[73254]:   </cpu>
Aug 14 15:04:47 user nova-compute[73254]:   <devices>
Aug 14 15:04:47 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:04:47 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:04:47 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue"/>
Aug 14 15:04:47 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:04:47 user nova-compute[73254]:     </disk>
Aug 14 15:04:47 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:04:47 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:04:47 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk"/>
Aug 14 15:04:47 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:04:47 user nova-compute[73254]:     </disk>
Aug 14 15:04:47 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:04:47 user nova-compute[73254]:       <mac address="fa:16:3e:24:39:49"/>
Aug 14 15:04:47 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:04:47 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:04:47 user nova-compute[73254]:       <target dev="tap61ad42be-87"/>
Aug 14 15:04:47 user nova-compute[73254]:     </interface>
Aug 14 15:04:47 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:04:47 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/console.log" append="off"/>
Aug 14 15:04:47 user nova-compute[73254]:     </serial>
Aug 14 15:04:47 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:04:47 user nova-compute[73254]:     <video>
Aug 14 15:04:47 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:04:47 user nova-compute[73254]:     </video>
Aug 14 15:04:47 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:04:47 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:04:47 user nova-compute[73254]:     </rng>
Aug 14 15:04:47 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:04:47 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:04:47 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:04:47 user nova-compute[73254]:     </memballoon>
Aug 14 15:04:47 user nova-compute[73254]:   </devices>
Aug 14 15:04:47 user nova-compute[73254]: </domain>
Aug 14 15:04:47 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:04:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Instance destroyed successfully.
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No VIF found with MAC fa:16:3e:24:39:49, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.459s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-1e494ec5-5a91-4cd1-85b5-0839bcd41897 req-4c497305-5bae-4bc2-b5cd-34969663d9ad service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-changed-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-1e494ec5-5a91-4cd1-85b5-0839bcd41897 req-4c497305-5bae-4bc2-b5cd-34969663d9ad service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Refreshing instance network info cache due to event network-changed-54c73d11-8f49-4e16-ae68-750d0c2cea9b. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1e494ec5-5a91-4cd1-85b5-0839bcd41897 req-4c497305-5bae-4bc2-b5cd-34969663d9ad service nova] Acquiring lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1e494ec5-5a91-4cd1-85b5-0839bcd41897 req-4c497305-5bae-4bc2-b5cd-34969663d9ad service nova] Acquired lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-1e494ec5-5a91-4cd1-85b5-0839bcd41897 req-4c497305-5bae-4bc2-b5cd-34969663d9ad service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Refreshing network info cache for port 54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:04:47 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Deleted allocations for instance 01e4cd7e-3fd9-47fe-870e-31fcd457e263
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025487.4630094, 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:04:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Successfully detached device vdb from instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 from the live domain config.
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdVQgqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:04:47 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d360ef78-7859-45d6-a96b-260dcbe6402a tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01e4cd7e-3fd9-47fe-870e-31fcd457e263" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.129s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffb3b88-8c62-41c9-989f-a2e3665cbeb6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a52442-2e15-4e11-9dce-67a00a6e547e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:47 user nova-compute[73254]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:47 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 (non-flash)
Aug 14 15:04:47 user nova-compute[73254]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:04:47 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6684c9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a739ef-bc22-497c-bd89-71bc6f0b2f2a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2607015-8785-4aca-8ea5-be1542b563b6]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[26492774-9952-4c8a-a605-079d007213ae]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a116b1-a550-4393-abaa-75b16a30e11e]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf09406-3f46-46a5-a47f-6d0486abaeeb]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[580d809a-24b5-46b2-a06f-875199c3c7bc]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260]
Aug 14 15:04:47 user nova-compute[73254]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932, portal: 172.16.0.220,3260] successful.
Aug 14 15:04:47 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5e02d324-2e59-4152-a018-d6f65bbd0932 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[06463cbe-ceb8-40fc-9ac9-c858f45fd3d9]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] <== disconnect_volume: return (336ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-1e494ec5-5a91-4cd1-85b5-0839bcd41897 req-4c497305-5bae-4bc2-b5cd-34969663d9ad service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updated VIF entry in instance network info cache for port 54c73d11-8f49-4e16-ae68-750d0c2cea9b. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-1e494ec5-5a91-4cd1-85b5-0839bcd41897 req-4c497305-5bae-4bc2-b5cd-34969663d9ad service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updating instance_info_cache with network_info: [{"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1e494ec5-5a91-4cd1-85b5-0839bcd41897 req-4c497305-5bae-4bc2-b5cd-34969663d9ad service nova] Releasing lock "refresh_cache-81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-vif-unplugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] No waiting events found dispatching network-vif-unplugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:48 user nova-compute[73254]: WARNING nova.compute.manager [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received unexpected event network-vif-unplugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e for instance with vm_state active and task_state rescuing.
Aug 14 15:04:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] No waiting events found dispatching network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:48 user nova-compute[73254]: WARNING nova.compute.manager [req-804fab3b-0d44-4acf-9126-ed3aaf2e4e28 req-6a5a2cb9-5d5b-41d1-9944-9b280b77bbf1 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received unexpected event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e for instance with vm_state active and task_state rescuing.
Aug 14 15:04:48 user nova-compute[73254]: DEBUG nova.objects.instance [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'flavor' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9c9479d6-a2f8-422e-ac3e-b95ee707e785 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.180s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] No waiting events found dispatching network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:50 user nova-compute[73254]: WARNING nova.compute.manager [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received unexpected event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e for instance with vm_state active and task_state rescuing.
Aug 14 15:04:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] No waiting events found dispatching network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:04:50 user nova-compute[73254]: WARNING nova.compute.manager [req-42b6a264-bfc8-448d-8cb1-cba75912fc5c req-a1981797-9f84-4d4e-8b98-de3a3df0ab9d service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received unexpected event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e for instance with vm_state active and task_state rescuing.
Aug 14 15:04:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for 52930af7-b452-4bff-a8cb-7e7859f99af6 due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:04:51 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025491.0531852, 52930af7-b452-4bff-a8cb-7e7859f99af6 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:51 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] VM Resumed (Lifecycle Event)
Aug 14 15:04:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-805341dd-3484-441a-890a-6d1a6bf024b2 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:04:51 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 15:04:51 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025491.055091, 52930af7-b452-4bff-a8cb-7e7859f99af6 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:51 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] VM Started (Lifecycle Event)
Aug 14 15:04:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:04:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:52 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025477.1008308, da915cb7-8ab5-4c65-928f-70e94811dd4e => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:52 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] VM Stopped (Lifecycle Event)
Aug 14 15:04:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3e643eed-0efd-45ec-9f43-ee88b8bcfbed None None] [instance: da915cb7-8ab5-4c65-928f-70e94811dd4e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:52 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025477.495643, 06fb12cd-0594-4480-ac26-2b30861395f6 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:04:52 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] VM Stopped (Lifecycle Event)
Aug 14 15:04:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c8471030-d3cf-4540-8124-9cc98e426ca9 None None] [instance: 06fb12cd-0594-4480-ac26-2b30861395f6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:04:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:04:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:04:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:04:58 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:04:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-108b5a5e-c517-4544-8aa4-5897bf026aac req-d6d6d8cd-5f42-41e4-b9ed-a7123826a308 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received event network-changed-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-108b5a5e-c517-4544-8aa4-5897bf026aac req-d6d6d8cd-5f42-41e4-b9ed-a7123826a308 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Refreshing instance network info cache due to event network-changed-4998f987-9e07-4317-b1b0-b0ee6c7cb815. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-108b5a5e-c517-4544-8aa4-5897bf026aac req-d6d6d8cd-5f42-41e4-b9ed-a7123826a308 service nova] Acquiring lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-108b5a5e-c517-4544-8aa4-5897bf026aac req-d6d6d8cd-5f42-41e4-b9ed-a7123826a308 service nova] Acquired lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG nova.network.neutron [req-108b5a5e-c517-4544-8aa4-5897bf026aac req-d6d6d8cd-5f42-41e4-b9ed-a7123826a308 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Refreshing network info cache for port 4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG nova.network.neutron [req-108b5a5e-c517-4544-8aa4-5897bf026aac req-d6d6d8cd-5f42-41e4-b9ed-a7123826a308 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Updated VIF entry in instance network info cache for port 4998f987-9e07-4317-b1b0-b0ee6c7cb815. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG nova.network.neutron [req-108b5a5e-c517-4544-8aa4-5897bf026aac req-d6d6d8cd-5f42-41e4-b9ed-a7123826a308 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Updating instance_info_cache with network_info: [{"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'flavor' on Instance uuid 83808001-6b81-4479-86ff-94bb588d22fd {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-108b5a5e-c517-4544-8aa4-5897bf026aac req-d6d6d8cd-5f42-41e4-b9ed-a7123826a308 service nova] Releasing lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:04:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:00 user nova-compute[73254]: INFO nova.compute.manager [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Attaching volume c9e402fb-ccb7-45af-a94c-4efea218d1e2 to /dev/vdb
Aug 14 15:05:00 user nova-compute[73254]: DEBUG os_brick.utils [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0e2dae-a6fc-4360-87d9-14ad3e2e0f3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[82963787-31d4-4f18-867a-975a86f35e18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3596478f-98d5-47e4-bacd-1f0151ffc26b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcaa9ae-f6cb-4531-8c95-f4405009568e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025485.277314, 01e4cd7e-3fd9-47fe-870e-31fcd457e263 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:05:00 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] VM Stopped (Lifecycle Event)
Aug 14 15:05:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:05:00 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32d4699-0420-4f84-8119-709af8e6ed28]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6cd74a7c-6024-48d5-a84d-6ec1edb11e83 None None] [instance: 01e4cd7e-3fd9-47fe-870e-31fcd457e263] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG os_brick.utils [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Updating existing volume attachment record: e19f7411-0553-4880-b655-0c95fb8063c2 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:03 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:05:03 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7239MB free_disk=25.31481170654297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 16996b6c-6d6e-4b51-88f3-0ca024e95639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0110dafc-b336-45bd-aade-0eb9ba632a05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 83808001-6b81-4479-86ff-94bb588d22fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 714586d7-babb-49e0-b2bd-e07cf4f47849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:05:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:05:04 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:05:04 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:05:04 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:05:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:06 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:05:06 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:05:06 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:05:06 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:05:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:05:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:05:06 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:05:06 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 16996b6c-6d6e-4b51-88f3-0ca024e95639 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:07 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Updating instance_info_cache with network_info: [{"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:05:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-16996b6c-6d6e-4b51-88f3-0ca024e95639" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:05:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:05:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:05:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:05:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:05:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:05:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:05:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQjYTZRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:05:09 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:05:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:05:09 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:05:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:05:09 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:05:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b9b684-e614-4b67-84aa-b1f130a4f2b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:05:09 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34ae949-e92f-4b3a-8943-cf266932c1e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2] added
Aug 14 15:05:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.188s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2616dabb-b119-438f-9ee8-a01dab31ebf6]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e84cf1-a82f-4e08-b20a-9ee919f554e1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mQjYTZRf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mQjYTZRf" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e94f464-ce7b-48fa-aa29-9c0a91f5e5ac]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mQjYTZRf'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c2cadb-e9e2-4ef0-b893-716be9dd0619]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f6ec54-7e92-4218-83b2-2d35f3be962d]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:05:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:05:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c849a1e-9ee6-413d-98d0-4e2d995b6ca2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2, portal: 172.16.0.220,3260]
Aug 14 15:05:10 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2, portal: 172.16.0.220,3260] successful.
Aug 14 15:05:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d3c91d-da96-4188-bba4-f5d2912b6903]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b315e95-4c04-4dd0-9806-420c5ec50ee4]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:05:10 user nova-compute[73254]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 (non-flash)
Aug 14 15:05:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:05:10 user nova-compute[73254]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 (non-flash)
Aug 14 15:05:10 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.437s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[85129e4d-da4c-4447-9f58-e48cdfac4727]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQjYTZRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:05:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] <== connect_volume: return (1470ms) {'type': 'block', 'scsi_wwn': '26637386530623635', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:05:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637386530623635', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:05:11 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'flavor' on Instance uuid 83808001-6b81-4479-86ff-94bb588d22fd {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:05:11 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:05:11 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:05:11 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:05:11 user nova-compute[73254]:   <serial>c9e402fb-ccb7-45af-a94c-4efea218d1e2</serial>
Aug 14 15:05:11 user nova-compute[73254]: </disk>
Aug 14 15:05:11 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:05:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:05:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:05:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] No VIF found with MAC fa:16:3e:27:d1:85, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:05:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f87dc4ce-e457-4300-bffd-b08d7e2eb082 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.792s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:13 user nova-compute[73254]: INFO nova.compute.manager [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Detaching volume c9e402fb-ccb7-45af-a94c-4efea218d1e2
Aug 14 15:05:13 user nova-compute[73254]: INFO nova.virt.block_device [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Attempting to driver detach volume c9e402fb-ccb7-45af-a94c-4efea218d1e2 from mountpoint /dev/vdb
Aug 14 15:05:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Attempting to detach device vdb from instance 83808001-6b81-4479-86ff-94bb588d22fd from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:05:13 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:05:13 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:05:13 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:05:13 user nova-compute[73254]:   <serial>c9e402fb-ccb7-45af-a94c-4efea218d1e2</serial>
Aug 14 15:05:13 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:05:13 user nova-compute[73254]: </disk>
Aug 14 15:05:13 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:05:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Successfully detached device vdb from instance 83808001-6b81-4479-86ff-94bb588d22fd from the persistent domain config.
Aug 14 15:05:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83808001-6b81-4479-86ff-94bb588d22fd from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:05:13 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:05:13 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:05:13 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:05:13 user nova-compute[73254]:   <serial>c9e402fb-ccb7-45af-a94c-4efea218d1e2</serial>
Aug 14 15:05:13 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:05:13 user nova-compute[73254]: </disk>
Aug 14 15:05:13 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025513.790939, 83808001-6b81-4479-86ff-94bb588d22fd => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83808001-6b81-4479-86ff-94bb588d22fd {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:05:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Successfully detached device vdb from instance 83808001-6b81-4479-86ff-94bb588d22fd from the live domain config.
Aug 14 15:05:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mQjYTZRf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:05:13 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[81947fbc-22be-4c9f-9ffb-b1c3698d677e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f956dbf2-197c-4299-a2a1-e0c88da9649e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:05:13 user nova-compute[73254]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 (non-flash)
Aug 14 15:05:13 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:05:13 user nova-compute[73254]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 (non-flash)
Aug 14 15:05:13 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6972e4160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[436cc68b-1b6a-4ff8-b89e-cf8d576de817]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f7306c-00fa-47cb-99e6-09ea475a8226]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecff705d-5895-4e7e-966d-76d5b680d534]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3db7c48-4d02-4d76-b1de-23f98a6f0b59]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c949765a-5924-474f-9917-cccce19d339d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[997be032-3865-44fa-8c6c-5d8c68c6e983]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2, portal: 172.16.0.220,3260]
Aug 14 15:05:14 user nova-compute[73254]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2, portal: 172.16.0.220,3260] successful.
Aug 14 15:05:14 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9e402fb-ccb7-45af-a94c-4efea218d1e2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77e2149-25ca-46fd-acb8-56a8c199d43e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] <== disconnect_volume: return (304ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'flavor' on Instance uuid 83808001-6b81-4479-86ff-94bb588d22fd {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f1aabfcf-b2ef-4543-8b2e-89c35a5f0023 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.671s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:05:17 user nova-compute[73254]: INFO nova.compute.claims [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Claim successful on node user
Aug 14 15:05:17 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:05:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:05:17 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:05:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG nova.policy [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec4cf769cd15416bbbc1b9def6d12202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f209fa7e3ab40a2b5b9dc6725195d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:05:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Creating image(s)
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "/opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "/opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "/opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk 1073741824" returned: 0 in 0.054s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Successfully created port: e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.193s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Checking if we can resize image /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Cannot resize image /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG nova.objects.instance [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'migration_context' on Instance uuid 456882f8-f70c-4a85-b593-c1066e732a9e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Ensure instance console log exists: /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:19 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Successfully updated port: e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:05:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "refresh_cache-456882f8-f70c-4a85-b593-c1066e732a9e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:05:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquired lock "refresh_cache-456882f8-f70c-4a85-b593-c1066e732a9e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:05:19 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:05:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-34056d2a-4e27-45a0-b69d-7964c4ab6a38 req-10abff39-05d7-4f45-8611-89829598c759 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-changed-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-34056d2a-4e27-45a0-b69d-7964c4ab6a38 req-10abff39-05d7-4f45-8611-89829598c759 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Refreshing instance network info cache due to event network-changed-e963bea9-b6dc-4cb1-be12-e5d5688d774e. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:05:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-34056d2a-4e27-45a0-b69d-7964c4ab6a38 req-10abff39-05d7-4f45-8611-89829598c759 service nova] Acquiring lock "refresh_cache-456882f8-f70c-4a85-b593-c1066e732a9e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:05:19 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Updating instance_info_cache with network_info: [{"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Releasing lock "refresh_cache-456882f8-f70c-4a85-b593-c1066e732a9e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Instance network_info: |[{"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-34056d2a-4e27-45a0-b69d-7964c4ab6a38 req-10abff39-05d7-4f45-8611-89829598c759 service nova] Acquired lock "refresh_cache-456882f8-f70c-4a85-b593-c1066e732a9e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.network.neutron [req-34056d2a-4e27-45a0-b69d-7964c4ab6a38 req-10abff39-05d7-4f45-8611-89829598c759 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Refreshing network info cache for port e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Start _get_guest_xml network_info=[{"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:05:20 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:05:20 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1719411706',display_name='tempest-AttachVolumeNegativeTest-server-1719411706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1719411706',id=21,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWi5E+Yw3b/LQ/GkHikNmQmhnVN0IZHSYacSlwaLjKqe7iuiyKWYZ/lO7OZeBfMM31MRFzQHzm9iLrKfN3vRimpcVkqkXDny502rGigSZnx41t9cxrIL2Fb6CRNyxAvBQ==',key_name='tempest-keypair-1022735574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-pkluukai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=456882f8-f70c-4a85-b593-c1066e732a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=e963bea9-b6dc-4cb1-be12-e5d5688d774e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape963bea9-b6') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.objects.instance [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'pci_devices' on Instance uuid 456882f8-f70c-4a85-b593-c1066e732a9e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:05:20 user nova-compute[73254]:   <uuid>456882f8-f70c-4a85-b593-c1066e732a9e</uuid>
Aug 14 15:05:20 user nova-compute[73254]:   <name>instance-00000015</name>
Aug 14 15:05:20 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:05:20 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:05:20 user nova-compute[73254]:   <metadata>
Aug 14 15:05:20 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:05:20 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:05:20 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1719411706</nova:name>
Aug 14 15:05:20 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:05:20</nova:creationTime>
Aug 14 15:05:20 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:05:20 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:05:20 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:05:20 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:05:20 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:05:20 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:05:20 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:05:20 user nova-compute[73254]:       <nova:owner>
Aug 14 15:05:20 user nova-compute[73254]:         <nova:user uuid="ec4cf769cd15416bbbc1b9def6d12202">tempest-AttachVolumeNegativeTest-476210608-project-member</nova:user>
Aug 14 15:05:20 user nova-compute[73254]:         <nova:project uuid="8f209fa7e3ab40a2b5b9dc6725195d22">tempest-AttachVolumeNegativeTest-476210608</nova:project>
Aug 14 15:05:20 user nova-compute[73254]:       </nova:owner>
Aug 14 15:05:20 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:05:20 user nova-compute[73254]:       <nova:ports>
Aug 14 15:05:20 user nova-compute[73254]:         <nova:port uuid="e963bea9-b6dc-4cb1-be12-e5d5688d774e">
Aug 14 15:05:20 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 15:05:20 user nova-compute[73254]:         </nova:port>
Aug 14 15:05:20 user nova-compute[73254]:       </nova:ports>
Aug 14 15:05:20 user nova-compute[73254]:     </nova:instance>
Aug 14 15:05:20 user nova-compute[73254]:   </metadata>
Aug 14 15:05:20 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:05:20 user nova-compute[73254]:     <system>
Aug 14 15:05:20 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:05:20 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:05:20 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:05:20 user nova-compute[73254]:       <entry name="serial">456882f8-f70c-4a85-b593-c1066e732a9e</entry>
Aug 14 15:05:20 user nova-compute[73254]:       <entry name="uuid">456882f8-f70c-4a85-b593-c1066e732a9e</entry>
Aug 14 15:05:20 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:05:20 user nova-compute[73254]:     </system>
Aug 14 15:05:20 user nova-compute[73254]:   </sysinfo>
Aug 14 15:05:20 user nova-compute[73254]:   <os>
Aug 14 15:05:20 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:05:20 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:05:20 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:05:20 user nova-compute[73254]:   </os>
Aug 14 15:05:20 user nova-compute[73254]:   <features>
Aug 14 15:05:20 user nova-compute[73254]:     <acpi/>
Aug 14 15:05:20 user nova-compute[73254]:     <apic/>
Aug 14 15:05:20 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:05:20 user nova-compute[73254]:   </features>
Aug 14 15:05:20 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:05:20 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:05:20 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:05:20 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:05:20 user nova-compute[73254]:   </clock>
Aug 14 15:05:20 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:05:20 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:05:20 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:05:20 user nova-compute[73254]:   </cpu>
Aug 14 15:05:20 user nova-compute[73254]:   <devices>
Aug 14 15:05:20 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:05:20 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:05:20 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk"/>
Aug 14 15:05:20 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:05:20 user nova-compute[73254]:     </disk>
Aug 14 15:05:20 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:05:20 user nova-compute[73254]:       <mac address="fa:16:3e:7f:79:fc"/>
Aug 14 15:05:20 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:05:20 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:05:20 user nova-compute[73254]:       <target dev="tape963bea9-b6"/>
Aug 14 15:05:20 user nova-compute[73254]:     </interface>
Aug 14 15:05:20 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:05:20 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/console.log" append="off"/>
Aug 14 15:05:20 user nova-compute[73254]:     </serial>
Aug 14 15:05:20 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:05:20 user nova-compute[73254]:     <video>
Aug 14 15:05:20 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:05:20 user nova-compute[73254]:     </video>
Aug 14 15:05:20 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:05:20 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:05:20 user nova-compute[73254]:     </rng>
Aug 14 15:05:20 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:05:20 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:05:20 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:05:20 user nova-compute[73254]:     </memballoon>
Aug 14 15:05:20 user nova-compute[73254]:   </devices>
Aug 14 15:05:20 user nova-compute[73254]: </domain>
Aug 14 15:05:20 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1719411706',display_name='tempest-AttachVolumeNegativeTest-server-1719411706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1719411706',id=21,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWi5E+Yw3b/LQ/GkHikNmQmhnVN0IZHSYacSlwaLjKqe7iuiyKWYZ/lO7OZeBfMM31MRFzQHzm9iLrKfN3vRimpcVkqkXDny502rGigSZnx41t9cxrIL2Fb6CRNyxAvBQ==',key_name='tempest-keypair-1022735574',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-pkluukai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=456882f8-f70c-4a85-b593-c1066e732a9e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=e963bea9-b6dc-4cb1-be12-e5d5688d774e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape963bea9-b6') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG os_vif [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=e963bea9-b6dc-4cb1-be12-e5d5688d774e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape963bea9-b6') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape963bea9-b6, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape963bea9-b6, col_values=(('external_ids', {'iface-id': 'e963bea9-b6dc-4cb1-be12-e5d5688d774e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:79:fc', 'vm-uuid': '456882f8-f70c-4a85-b593-c1066e732a9e'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:20 user nova-compute[73254]: INFO os_vif [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=e963bea9-b6dc-4cb1-be12-e5d5688d774e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape963bea9-b6')
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:05:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No VIF found with MAC fa:16:3e:7f:79:fc, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:05:21 user nova-compute[73254]: DEBUG nova.network.neutron [req-34056d2a-4e27-45a0-b69d-7964c4ab6a38 req-10abff39-05d7-4f45-8611-89829598c759 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Updated VIF entry in instance network info cache for port e963bea9-b6dc-4cb1-be12-e5d5688d774e. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:05:21 user nova-compute[73254]: DEBUG nova.network.neutron [req-34056d2a-4e27-45a0-b69d-7964c4ab6a38 req-10abff39-05d7-4f45-8611-89829598c759 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Updating instance_info_cache with network_info: [{"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:05:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-34056d2a-4e27-45a0-b69d-7964c4ab6a38 req-10abff39-05d7-4f45-8611-89829598c759 service nova] Releasing lock "refresh_cache-456882f8-f70c-4a85-b593-c1066e732a9e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:05:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "7149269a-b4a2-4500-a426-d31dd315a369" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "7149269a-b4a2-4500-a426-d31dd315a369" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-a44ac90d-4e66-4d5c-854d-6a1adb82e993 req-6e7be03c-83f9-4386-a731-e528c11bbc52 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a44ac90d-4e66-4d5c-854d-6a1adb82e993 req-6e7be03c-83f9-4386-a731-e528c11bbc52 service nova] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a44ac90d-4e66-4d5c-854d-6a1adb82e993 req-6e7be03c-83f9-4386-a731-e528c11bbc52 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a44ac90d-4e66-4d5c-854d-6a1adb82e993 req-6e7be03c-83f9-4386-a731-e528c11bbc52 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-a44ac90d-4e66-4d5c-854d-6a1adb82e993 req-6e7be03c-83f9-4386-a731-e528c11bbc52 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] No waiting events found dispatching network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:05:22 user nova-compute[73254]: WARNING nova.compute.manager [req-a44ac90d-4e66-4d5c-854d-6a1adb82e993 req-6e7be03c-83f9-4386-a731-e528c11bbc52 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received unexpected event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e for instance with vm_state building and task_state spawning.
Aug 14 15:05:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:05:22 user nova-compute[73254]: INFO nova.compute.claims [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Claim successful on node user
Aug 14 15:05:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.432s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:05:22 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.policy [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e56bbc03d7af4dec928da4d490af7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7dd480b32e4059b4d265a6049963e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:05:22 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Creating image(s)
Aug 14 15:05:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "/opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "/opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "/opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.170s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.174s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk 1073741824" returned: 0 in 0.061s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Successfully created port: f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Cannot resize image /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.objects.instance [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'migration_context' on Instance uuid 7149269a-b4a2-4500-a426-d31dd315a369 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Ensure instance console log exists: /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025523.9567544, 456882f8-f70c-4a85-b593-c1066e732a9e => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:05:23 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] VM Resumed (Lifecycle Event)
Aug 14 15:05:23 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Instance spawned successfully.
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:05:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:05:24 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025523.9585602, 456882f8-f70c-4a85-b593-c1066e732a9e => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:05:24 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] VM Started (Lifecycle Event)
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:05:24 user nova-compute[73254]: INFO nova.compute.manager [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-020fc2a9-197f-4639-b971-425cea2b8021 req-80cac547-9676-43a0-a225-93e9d65545e8 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-020fc2a9-197f-4639-b971-425cea2b8021 req-80cac547-9676-43a0-a225-93e9d65545e8 service nova] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-020fc2a9-197f-4639-b971-425cea2b8021 req-80cac547-9676-43a0-a225-93e9d65545e8 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-020fc2a9-197f-4639-b971-425cea2b8021 req-80cac547-9676-43a0-a225-93e9d65545e8 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-020fc2a9-197f-4639-b971-425cea2b8021 req-80cac547-9676-43a0-a225-93e9d65545e8 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] No waiting events found dispatching network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:05:24 user nova-compute[73254]: WARNING nova.compute.manager [req-020fc2a9-197f-4639-b971-425cea2b8021 req-80cac547-9676-43a0-a225-93e9d65545e8 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received unexpected event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e for instance with vm_state building and task_state spawning.
Aug 14 15:05:24 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Successfully updated port: f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquired lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-c072ea1f-e4db-4df3-aac5-17bd6d966750 req-57fd26a6-6b9d-4a88-8f34-8cb65990e632 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received event network-changed-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-c072ea1f-e4db-4df3-aac5-17bd6d966750 req-57fd26a6-6b9d-4a88-8f34-8cb65990e632 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Refreshing instance network info cache due to event network-changed-f088be4d-4968-414e-aca6-6594f9bc2e06. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c072ea1f-e4db-4df3-aac5-17bd6d966750 req-57fd26a6-6b9d-4a88-8f34-8cb65990e632 service nova] Acquiring lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:05:24 user nova-compute[73254]: INFO nova.compute.manager [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Took 6.89 seconds to build instance.
Aug 14 15:05:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ec8938fa-69c3-44ed-b3a9-b542977a1cb0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.983s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updating instance_info_cache with network_info: [{"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Releasing lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Instance network_info: |[{"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c072ea1f-e4db-4df3-aac5-17bd6d966750 req-57fd26a6-6b9d-4a88-8f34-8cb65990e632 service nova] Acquired lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.neutron [req-c072ea1f-e4db-4df3-aac5-17bd6d966750 req-57fd26a6-6b9d-4a88-8f34-8cb65990e632 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Refreshing network info cache for port f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Start _get_guest_xml network_info=[{"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:05:24 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:05:24 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-852943693',display_name='tempest-ServerActionsTestOtherA-server-852943693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-852943693',id=22,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVC3LG9bN01HlSiMNZhDA0zEYEcGLDrYhPpLJz9ta218GScDSC8eEo3thhKHy7nQaAVL89N9YcF8sXNEgn/eaLjWVETDYOO04B8PSlrVv3eBig80mH0AK7hGooJqv3yA==',key_name='tempest-keypair-384224305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-0xz1edob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:05:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=7149269a-b4a2-4500-a426-d31dd315a369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ae:8f,bridge_name='br-int',has_traffic_filtering=True,id=f088be4d-4968-414e-aca6-6594f9bc2e06,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf088be4d-49') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.objects.instance [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'pci_devices' on Instance uuid 7149269a-b4a2-4500-a426-d31dd315a369 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:05:24 user nova-compute[73254]:   <uuid>7149269a-b4a2-4500-a426-d31dd315a369</uuid>
Aug 14 15:05:24 user nova-compute[73254]:   <name>instance-00000016</name>
Aug 14 15:05:24 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:05:24 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:05:24 user nova-compute[73254]:   <metadata>
Aug 14 15:05:24 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:05:24 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:05:24 user nova-compute[73254]:       <nova:name>tempest-ServerActionsTestOtherA-server-852943693</nova:name>
Aug 14 15:05:24 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:05:24</nova:creationTime>
Aug 14 15:05:24 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:05:24 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:05:24 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:05:24 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:05:24 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:05:24 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:05:24 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:05:24 user nova-compute[73254]:       <nova:owner>
Aug 14 15:05:24 user nova-compute[73254]:         <nova:user uuid="e56bbc03d7af4dec928da4d490af7b76">tempest-ServerActionsTestOtherA-1005131430-project-member</nova:user>
Aug 14 15:05:24 user nova-compute[73254]:         <nova:project uuid="8a7dd480b32e4059b4d265a6049963e4">tempest-ServerActionsTestOtherA-1005131430</nova:project>
Aug 14 15:05:24 user nova-compute[73254]:       </nova:owner>
Aug 14 15:05:24 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:05:24 user nova-compute[73254]:       <nova:ports>
Aug 14 15:05:24 user nova-compute[73254]:         <nova:port uuid="f088be4d-4968-414e-aca6-6594f9bc2e06">
Aug 14 15:05:24 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 15:05:24 user nova-compute[73254]:         </nova:port>
Aug 14 15:05:24 user nova-compute[73254]:       </nova:ports>
Aug 14 15:05:24 user nova-compute[73254]:     </nova:instance>
Aug 14 15:05:24 user nova-compute[73254]:   </metadata>
Aug 14 15:05:24 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:05:24 user nova-compute[73254]:     <system>
Aug 14 15:05:24 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:05:24 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:05:24 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:05:24 user nova-compute[73254]:       <entry name="serial">7149269a-b4a2-4500-a426-d31dd315a369</entry>
Aug 14 15:05:24 user nova-compute[73254]:       <entry name="uuid">7149269a-b4a2-4500-a426-d31dd315a369</entry>
Aug 14 15:05:24 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:05:24 user nova-compute[73254]:     </system>
Aug 14 15:05:24 user nova-compute[73254]:   </sysinfo>
Aug 14 15:05:24 user nova-compute[73254]:   <os>
Aug 14 15:05:24 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:05:24 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:05:24 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:05:24 user nova-compute[73254]:   </os>
Aug 14 15:05:24 user nova-compute[73254]:   <features>
Aug 14 15:05:24 user nova-compute[73254]:     <acpi/>
Aug 14 15:05:24 user nova-compute[73254]:     <apic/>
Aug 14 15:05:24 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:05:24 user nova-compute[73254]:   </features>
Aug 14 15:05:24 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:05:24 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:05:24 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:05:24 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:05:24 user nova-compute[73254]:   </clock>
Aug 14 15:05:24 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:05:24 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:05:24 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:05:24 user nova-compute[73254]:   </cpu>
Aug 14 15:05:24 user nova-compute[73254]:   <devices>
Aug 14 15:05:24 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:05:24 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:05:24 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk"/>
Aug 14 15:05:24 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:05:24 user nova-compute[73254]:     </disk>
Aug 14 15:05:24 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:05:24 user nova-compute[73254]:       <mac address="fa:16:3e:3a:ae:8f"/>
Aug 14 15:05:24 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:05:24 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:05:24 user nova-compute[73254]:       <target dev="tapf088be4d-49"/>
Aug 14 15:05:24 user nova-compute[73254]:     </interface>
Aug 14 15:05:24 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:05:24 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/console.log" append="off"/>
Aug 14 15:05:24 user nova-compute[73254]:     </serial>
Aug 14 15:05:24 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:05:24 user nova-compute[73254]:     <video>
Aug 14 15:05:24 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:05:24 user nova-compute[73254]:     </video>
Aug 14 15:05:24 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:05:24 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:05:24 user nova-compute[73254]:     </rng>
Aug 14 15:05:24 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:05:24 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:05:24 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:05:24 user nova-compute[73254]:     </memballoon>
Aug 14 15:05:24 user nova-compute[73254]:   </devices>
Aug 14 15:05:24 user nova-compute[73254]: </domain>
Aug 14 15:05:24 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-852943693',display_name='tempest-ServerActionsTestOtherA-server-852943693',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-852943693',id=22,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVC3LG9bN01HlSiMNZhDA0zEYEcGLDrYhPpLJz9ta218GScDSC8eEo3thhKHy7nQaAVL89N9YcF8sXNEgn/eaLjWVETDYOO04B8PSlrVv3eBig80mH0AK7hGooJqv3yA==',key_name='tempest-keypair-384224305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-0xz1edob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:05:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=7149269a-b4a2-4500-a426-d31dd315a369,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ae:8f,bridge_name='br-int',has_traffic_filtering=True,id=f088be4d-4968-414e-aca6-6594f9bc2e06,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf088be4d-49') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG os_vif [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ae:8f,bridge_name='br-int',has_traffic_filtering=True,id=f088be4d-4968-414e-aca6-6594f9bc2e06,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf088be4d-49') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf088be4d-49, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf088be4d-49, col_values=(('external_ids', {'iface-id': 'f088be4d-4968-414e-aca6-6594f9bc2e06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ae:8f', 'vm-uuid': '7149269a-b4a2-4500-a426-d31dd315a369'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:24 user nova-compute[73254]: INFO os_vif [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ae:8f,bridge_name='br-int',has_traffic_filtering=True,id=f088be4d-4968-414e-aca6-6594f9bc2e06,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf088be4d-49')
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No VIF found with MAC fa:16:3e:3a:ae:8f, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.neutron [req-c072ea1f-e4db-4df3-aac5-17bd6d966750 req-57fd26a6-6b9d-4a88-8f34-8cb65990e632 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updated VIF entry in instance network info cache for port f088be4d-4968-414e-aca6-6594f9bc2e06. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG nova.network.neutron [req-c072ea1f-e4db-4df3-aac5-17bd6d966750 req-57fd26a6-6b9d-4a88-8f34-8cb65990e632 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updating instance_info_cache with network_info: [{"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:05:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c072ea1f-e4db-4df3-aac5-17bd6d966750 req-57fd26a6-6b9d-4a88-8f34-8cb65990e632 service nova] Releasing lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:05:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-1428c5ed-56b4-4e79-ba57-11388b59bb0f req-f3a64f74-45fd-45a1-8d64-eb4a2a513a41 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received event network-vif-plugged-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1428c5ed-56b4-4e79-ba57-11388b59bb0f req-f3a64f74-45fd-45a1-8d64-eb4a2a513a41 service nova] Acquiring lock "7149269a-b4a2-4500-a426-d31dd315a369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1428c5ed-56b4-4e79-ba57-11388b59bb0f req-f3a64f74-45fd-45a1-8d64-eb4a2a513a41 service nova] Lock "7149269a-b4a2-4500-a426-d31dd315a369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1428c5ed-56b4-4e79-ba57-11388b59bb0f req-f3a64f74-45fd-45a1-8d64-eb4a2a513a41 service nova] Lock "7149269a-b4a2-4500-a426-d31dd315a369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-1428c5ed-56b4-4e79-ba57-11388b59bb0f req-f3a64f74-45fd-45a1-8d64-eb4a2a513a41 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] No waiting events found dispatching network-vif-plugged-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:05:26 user nova-compute[73254]: WARNING nova.compute.manager [req-1428c5ed-56b4-4e79-ba57-11388b59bb0f req-f3a64f74-45fd-45a1-8d64-eb4a2a513a41 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received unexpected event network-vif-plugged-f088be4d-4968-414e-aca6-6594f9bc2e06 for instance with vm_state building and task_state spawning.
Aug 14 15:05:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025528.1203253, 7149269a-b4a2-4500-a426-d31dd315a369 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:05:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] VM Resumed (Lifecycle Event)
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:05:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Instance spawned successfully.
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025528.1385481, 7149269a-b4a2-4500-a426-d31dd315a369 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:05:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] VM Started (Lifecycle Event)
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:05:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:05:28 user nova-compute[73254]: INFO nova.compute.manager [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Took 5.31 seconds to spawn the instance on the hypervisor.
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:28 user nova-compute[73254]: INFO nova.compute.manager [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Took 6.25 seconds to build instance.
Aug 14 15:05:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bd000b2f-243c-487e-91bf-ed9c3de5dd7c tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "7149269a-b4a2-4500-a426-d31dd315a369" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.373s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-403f8250-28e1-4597-8b72-9249e325fce5 req-49796053-b417-4812-8d48-785a60545082 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received event network-vif-plugged-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-403f8250-28e1-4597-8b72-9249e325fce5 req-49796053-b417-4812-8d48-785a60545082 service nova] Acquiring lock "7149269a-b4a2-4500-a426-d31dd315a369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-403f8250-28e1-4597-8b72-9249e325fce5 req-49796053-b417-4812-8d48-785a60545082 service nova] Lock "7149269a-b4a2-4500-a426-d31dd315a369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-403f8250-28e1-4597-8b72-9249e325fce5 req-49796053-b417-4812-8d48-785a60545082 service nova] Lock "7149269a-b4a2-4500-a426-d31dd315a369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-403f8250-28e1-4597-8b72-9249e325fce5 req-49796053-b417-4812-8d48-785a60545082 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] No waiting events found dispatching network-vif-plugged-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:05:28 user nova-compute[73254]: WARNING nova.compute.manager [req-403f8250-28e1-4597-8b72-9249e325fce5 req-49796053-b417-4812-8d48-785a60545082 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received unexpected event network-vif-plugged-f088be4d-4968-414e-aca6-6594f9bc2e06 for instance with vm_state active and task_state None.
Aug 14 15:05:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:35 user nova-compute[73254]: INFO nova.compute.manager [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] instance snapshotting
Aug 14 15:05:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Beginning live snapshot process
Aug 14 15:05:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json -f qcow2 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json -f qcow2" returned: 0 in 0.238s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json -f qcow2 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json -f qcow2" returned: 0 in 0.223s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp95jfwr_g/4662e26402ea449aadc0bd2f23f4e2ff.delta 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp95jfwr_g/4662e26402ea449aadc0bd2f23f4e2ff.delta 1073741824" returned: 0 in 0.058s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:36 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 15:05:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73254) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 15:05:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] COPY block job progress, current cursor: 47841280 final cursor: 75497472 {{(pid=73254) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 15:05:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73254) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 15:05:38 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 15:05:38 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:05:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp95jfwr_g/4662e26402ea449aadc0bd2f23f4e2ff.delta /opt/stack/data/nova/instances/snapshots/tmp95jfwr_g/4662e26402ea449aadc0bd2f23f4e2ff {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp95jfwr_g/4662e26402ea449aadc0bd2f23f4e2ff.delta /opt/stack/data/nova/instances/snapshots/tmp95jfwr_g/4662e26402ea449aadc0bd2f23f4e2ff" returned: 0 in 0.898s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:39 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Snapshot extracted, beginning image upload
Aug 14 15:05:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01773c99-e739-4da9-8c0b-493556a46e2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:05:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:39 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:05:39 user nova-compute[73254]: INFO nova.compute.claims [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Claim successful on node user
Aug 14 15:05:40 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:05:40 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:05:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:05:40 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Creating image(s)
Aug 14 15:05:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "/opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "/opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "/opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:40 user nova-compute[73254]: DEBUG nova.policy [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abc1e49d76ae4690b8ab6b1dd5ec5eae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ac5a724189545548484fba6d4e0c842', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.229s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.269s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk 1073741824" returned: 0 in 0.060s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.338s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.227s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Checking if we can resize image /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Successfully created port: 7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Cannot resize image /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'migration_context' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Ensure instance console log exists: /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Snapshot image upload complete
Aug 14 15:05:42 user nova-compute[73254]: INFO nova.compute.manager [None req-a1749676-5741-4d76-91ae-9b18527f781c tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Took 7.26 seconds to snapshot the instance on the hypervisor.
Aug 14 15:05:43 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Successfully updated port: 7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:05:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:05:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquired lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:05:43 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:05:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-9d5341aa-f253-430f-84e5-55feb2063653 req-3e80ec10-6cfd-4c20-9b2d-feac0e0ea84b service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-changed-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-9d5341aa-f253-430f-84e5-55feb2063653 req-3e80ec10-6cfd-4c20-9b2d-feac0e0ea84b service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Refreshing instance network info cache due to event network-changed-7c5be923-e482-480c-881d-36637fb4d86c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:05:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d5341aa-f253-430f-84e5-55feb2063653 req-3e80ec10-6cfd-4c20-9b2d-feac0e0ea84b service nova] Acquiring lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:44 user nova-compute[73254]: INFO nova.compute.manager [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Terminating instance
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updating instance_info_cache with network_info: [{"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Releasing lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Instance network_info: |[{"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d5341aa-f253-430f-84e5-55feb2063653 req-3e80ec10-6cfd-4c20-9b2d-feac0e0ea84b service nova] Acquired lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.network.neutron [req-9d5341aa-f253-430f-84e5-55feb2063653 req-3e80ec10-6cfd-4c20-9b2d-feac0e0ea84b service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Refreshing network info cache for port 7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Start _get_guest_xml network_info=[{"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:05:44 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:05:44 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1981963554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1981963554',id=23,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORSMumc2z175KKxihxVqK5oLz7MtI9h0M1I9f6H36K99R6/T4QxMbFp3dDAEaOZsaRFaNu/Jq/XS2WT9vamTQxN78Bnq23SgKqo3YMAj5bIo7u2btB7GrvS9VpGXi9LZQ==',key_name='tempest-keypair-1788138174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-u0ndwxw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:05:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01773c99-e739-4da9-8c0b-493556a46e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'pci_devices' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:05:44 user nova-compute[73254]:   <uuid>01773c99-e739-4da9-8c0b-493556a46e2d</uuid>
Aug 14 15:05:44 user nova-compute[73254]:   <name>instance-00000017</name>
Aug 14 15:05:44 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:05:44 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:05:44 user nova-compute[73254]:   <metadata>
Aug 14 15:05:44 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:05:44 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:05:44 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1981963554</nova:name>
Aug 14 15:05:44 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:05:44</nova:creationTime>
Aug 14 15:05:44 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:05:44 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:05:44 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:05:44 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:05:44 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:05:44 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:05:44 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:05:44 user nova-compute[73254]:       <nova:owner>
Aug 14 15:05:44 user nova-compute[73254]:         <nova:user uuid="abc1e49d76ae4690b8ab6b1dd5ec5eae">tempest-AttachVolumeShelveTestJSON-960640486-project-member</nova:user>
Aug 14 15:05:44 user nova-compute[73254]:         <nova:project uuid="3ac5a724189545548484fba6d4e0c842">tempest-AttachVolumeShelveTestJSON-960640486</nova:project>
Aug 14 15:05:44 user nova-compute[73254]:       </nova:owner>
Aug 14 15:05:44 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:05:44 user nova-compute[73254]:       <nova:ports>
Aug 14 15:05:44 user nova-compute[73254]:         <nova:port uuid="7c5be923-e482-480c-881d-36637fb4d86c">
Aug 14 15:05:44 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 15:05:44 user nova-compute[73254]:         </nova:port>
Aug 14 15:05:44 user nova-compute[73254]:       </nova:ports>
Aug 14 15:05:44 user nova-compute[73254]:     </nova:instance>
Aug 14 15:05:44 user nova-compute[73254]:   </metadata>
Aug 14 15:05:44 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:05:44 user nova-compute[73254]:     <system>
Aug 14 15:05:44 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:05:44 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:05:44 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:05:44 user nova-compute[73254]:       <entry name="serial">01773c99-e739-4da9-8c0b-493556a46e2d</entry>
Aug 14 15:05:44 user nova-compute[73254]:       <entry name="uuid">01773c99-e739-4da9-8c0b-493556a46e2d</entry>
Aug 14 15:05:44 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:05:44 user nova-compute[73254]:     </system>
Aug 14 15:05:44 user nova-compute[73254]:   </sysinfo>
Aug 14 15:05:44 user nova-compute[73254]:   <os>
Aug 14 15:05:44 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:05:44 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:05:44 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:05:44 user nova-compute[73254]:   </os>
Aug 14 15:05:44 user nova-compute[73254]:   <features>
Aug 14 15:05:44 user nova-compute[73254]:     <acpi/>
Aug 14 15:05:44 user nova-compute[73254]:     <apic/>
Aug 14 15:05:44 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:05:44 user nova-compute[73254]:   </features>
Aug 14 15:05:44 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:05:44 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:05:44 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:05:44 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:05:44 user nova-compute[73254]:   </clock>
Aug 14 15:05:44 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:05:44 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:05:44 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:05:44 user nova-compute[73254]:   </cpu>
Aug 14 15:05:44 user nova-compute[73254]:   <devices>
Aug 14 15:05:44 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:05:44 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:05:44 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk"/>
Aug 14 15:05:44 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:05:44 user nova-compute[73254]:     </disk>
Aug 14 15:05:44 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:05:44 user nova-compute[73254]:       <mac address="fa:16:3e:bc:6e:cb"/>
Aug 14 15:05:44 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:05:44 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:05:44 user nova-compute[73254]:       <target dev="tap7c5be923-e4"/>
Aug 14 15:05:44 user nova-compute[73254]:     </interface>
Aug 14 15:05:44 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:05:44 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/console.log" append="off"/>
Aug 14 15:05:44 user nova-compute[73254]:     </serial>
Aug 14 15:05:44 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:05:44 user nova-compute[73254]:     <video>
Aug 14 15:05:44 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:05:44 user nova-compute[73254]:     </video>
Aug 14 15:05:44 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:05:44 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:05:44 user nova-compute[73254]:     </rng>
Aug 14 15:05:44 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:05:44 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:05:44 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:05:44 user nova-compute[73254]:     </memballoon>
Aug 14 15:05:44 user nova-compute[73254]:   </devices>
Aug 14 15:05:44 user nova-compute[73254]: </domain>
Aug 14 15:05:44 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1981963554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1981963554',id=23,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORSMumc2z175KKxihxVqK5oLz7MtI9h0M1I9f6H36K99R6/T4QxMbFp3dDAEaOZsaRFaNu/Jq/XS2WT9vamTQxN78Bnq23SgKqo3YMAj5bIo7u2btB7GrvS9VpGXi9LZQ==',key_name='tempest-keypair-1788138174',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-u0ndwxw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:05:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01773c99-e739-4da9-8c0b-493556a46e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG os_vif [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c5be923-e4, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c5be923-e4, col_values=(('external_ids', {'iface-id': '7c5be923-e482-480c-881d-36637fb4d86c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:6e:cb', 'vm-uuid': '01773c99-e739-4da9-8c0b-493556a46e2d'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Instance destroyed successfully.
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.objects.instance [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'resources' on Instance uuid 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:00:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-230610477',display_name='tempest-TestMinimumBasicScenario-server-230610477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-230610477',id=13,image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5ULTwch7uAvfJ98sDf6jNl80RmElLj5L4Z/IsYvkUB78J8+ETM0qoah7POpI+iRPMndWlC9GBpuQk3Hewhkl3N7ftFItYhb2+jfwzTfkCI1veITs45QF0ygrq6l6wz1Q==',key_name='tempest-TestMinimumBasicScenario-2005249306',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:00:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='038244b91aad403897eb49752db371e7',ramdisk_id='',reservation_id='r-3h6820pm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a0220f8b-97d4-42fe-9697-e709062be4a4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-270556114',owner_user_name='tempest-TestMinimumBasicScenario-270556114-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:03:05Z,user_data=None,user_id='55b05671f1cb4c05a7bedb3559968162',uuid=81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converting VIF {"id": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "address": "fa:16:3e:53:33:f6", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c73d11-8f", "ovs_interfaceid": "54c73d11-8f49-4e16-ae68-750d0c2cea9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG os_vif [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: INFO os_vif [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4')
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54c73d11-8f, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:05:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:44 user nova-compute[73254]: INFO os_vif [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:33:f6,bridge_name='br-int',has_traffic_filtering=True,id=54c73d11-8f49-4e16-ae68-750d0c2cea9b,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c73d11-8f')
Aug 14 15:05:44 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Deleting instance files /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7_del
Aug 14 15:05:44 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Deletion of /opt/stack/data/nova/instances/81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7_del complete
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] No VIF found with MAC fa:16:3e:bc:6e:cb, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:05:45 user nova-compute[73254]: INFO nova.compute.manager [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 14 15:05:45 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.network.neutron [req-9d5341aa-f253-430f-84e5-55feb2063653 req-3e80ec10-6cfd-4c20-9b2d-feac0e0ea84b service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updated VIF entry in instance network info cache for port 7c5be923-e482-480c-881d-36637fb4d86c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.network.neutron [req-9d5341aa-f253-430f-84e5-55feb2063653 req-3e80ec10-6cfd-4c20-9b2d-feac0e0ea84b service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updating instance_info_cache with network_info: [{"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d5341aa-f253-430f-84e5-55feb2063653 req-3e80ec10-6cfd-4c20-9b2d-feac0e0ea84b service nova] Releasing lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-48bd684f-e6bb-4e90-ae82-d723349b9d01 req-e6ede447-6dbc-4933-9d53-de988f12ef27 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-vif-unplugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-48bd684f-e6bb-4e90-ae82-d723349b9d01 req-e6ede447-6dbc-4933-9d53-de988f12ef27 service nova] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-48bd684f-e6bb-4e90-ae82-d723349b9d01 req-e6ede447-6dbc-4933-9d53-de988f12ef27 service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-48bd684f-e6bb-4e90-ae82-d723349b9d01 req-e6ede447-6dbc-4933-9d53-de988f12ef27 service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-48bd684f-e6bb-4e90-ae82-d723349b9d01 req-e6ede447-6dbc-4933-9d53-de988f12ef27 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] No waiting events found dispatching network-vif-unplugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-48bd684f-e6bb-4e90-ae82-d723349b9d01 req-e6ede447-6dbc-4933-9d53-de988f12ef27 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-vif-unplugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:05:45 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Took 0.91 seconds to deallocate network for instance.
Aug 14 15:05:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-d3444a9d-9f44-4b6e-8645-d87ba509c515 req-b6ce67fa-a0c9-4d1e-8324-21467dc3b634 service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-vif-deleted-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:46 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:05:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:46 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:05:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.506s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:46 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Deleted allocations for instance 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7
Aug 14 15:05:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-170d38a6-6219-49de-86ce-e76dd0056d48 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.687s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:05:47 user nova-compute[73254]: INFO nova.compute.claims [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Claim successful on node user
Aug 14 15:05:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-ffdf71c3-c6d2-4e66-8bd2-894e09462fde req-a7f5c772-8d5d-40fb-8c4f-39ead813bb5f service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ffdf71c3-c6d2-4e66-8bd2-894e09462fde req-a7f5c772-8d5d-40fb-8c4f-39ead813bb5f service nova] Acquiring lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ffdf71c3-c6d2-4e66-8bd2-894e09462fde req-a7f5c772-8d5d-40fb-8c4f-39ead813bb5f service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ffdf71c3-c6d2-4e66-8bd2-894e09462fde req-a7f5c772-8d5d-40fb-8c4f-39ead813bb5f service nova] Lock "81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-ffdf71c3-c6d2-4e66-8bd2-894e09462fde req-a7f5c772-8d5d-40fb-8c4f-39ead813bb5f service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] No waiting events found dispatching network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:05:47 user nova-compute[73254]: WARNING nova.compute.manager [req-ffdf71c3-c6d2-4e66-8bd2-894e09462fde req-a7f5c772-8d5d-40fb-8c4f-39ead813bb5f service nova] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Received unexpected event network-vif-plugged-54c73d11-8f49-4e16-ae68-750d0c2cea9b for instance with vm_state deleted and task_state None.
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] No waiting events found dispatching network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:05:48 user nova-compute[73254]: WARNING nova.compute.manager [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received unexpected event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c for instance with vm_state building and task_state spawning.
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] No waiting events found dispatching network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:05:48 user nova-compute[73254]: WARNING nova.compute.manager [req-a94b2466-71cb-4aeb-a3df-ca100da1ed9b req-2311ed29-f08e-4519-b92d-68e4de53f18e service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received unexpected event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c for instance with vm_state building and task_state spawning.
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.696s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.network.neutron [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:05:48 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.policy [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '33829eb577bb4ff1a509164d476b4f1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07419af6d6584e63b16a633a403c2a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:05:48 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Creating image(s)
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "/opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "/opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "/opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.201s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:48 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.220s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025549.0517213, 01773c99-e739-4da9-8c0b-493556a46e2d => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:05:49 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] VM Resumed (Lifecycle Event)
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk 1073741824" returned: 0 in 0.057s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Instance spawned successfully.
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:05:49 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025549.0526638, 01773c99-e739-4da9-8c0b-493556a46e2d => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:05:49 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] VM Started (Lifecycle Event)
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.network.neutron [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Successfully created port: f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:05:49 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.212s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:49 user nova-compute[73254]: INFO nova.compute.manager [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Took 8.54 seconds to spawn the instance on the hypervisor.
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:49 user nova-compute[73254]: INFO nova.compute.manager [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Took 9.69 seconds to build instance.
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4937f9f-9668-44d7-9a4c-e7c8643e46fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01773c99-e739-4da9-8c0b-493556a46e2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.835s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Cannot resize image /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.objects.instance [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lazy-loading 'migration_context' on Instance uuid 923c2b29-3db6-4642-bbf0-e45c0ca6a2be {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Ensure instance console log exists: /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Successfully updated port: f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "refresh_cache-923c2b29-3db6-4642-bbf0-e45c0ca6a2be" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquired lock "refresh_cache-923c2b29-3db6-4642-bbf0-e45c0ca6a2be" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-4750457f-b83f-4b0a-84c6-a795874f0d69 req-c16c3b16-54b5-4923-b6b9-bead3c80970e service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Received event network-changed-f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-4750457f-b83f-4b0a-84c6-a795874f0d69 req-c16c3b16-54b5-4923-b6b9-bead3c80970e service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Refreshing instance network info cache due to event network-changed-f4b7c4e6-115b-4b49-9e46-f3092bc8272d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4750457f-b83f-4b0a-84c6-a795874f0d69 req-c16c3b16-54b5-4923-b6b9-bead3c80970e service nova] Acquiring lock "refresh_cache-923c2b29-3db6-4642-bbf0-e45c0ca6a2be" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Updating instance_info_cache with network_info: [{"id": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "address": "fa:16:3e:87:f2:b4", "network": {"id": "484f23e4-baa6-4c34-9913-4d79937ed2b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454098557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07419af6d6584e63b16a633a403c2a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b7c4e6-11", "ovs_interfaceid": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Releasing lock "refresh_cache-923c2b29-3db6-4642-bbf0-e45c0ca6a2be" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Instance network_info: |[{"id": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "address": "fa:16:3e:87:f2:b4", "network": {"id": "484f23e4-baa6-4c34-9913-4d79937ed2b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454098557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07419af6d6584e63b16a633a403c2a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b7c4e6-11", "ovs_interfaceid": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4750457f-b83f-4b0a-84c6-a795874f0d69 req-c16c3b16-54b5-4923-b6b9-bead3c80970e service nova] Acquired lock "refresh_cache-923c2b29-3db6-4642-bbf0-e45c0ca6a2be" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.network.neutron [req-4750457f-b83f-4b0a-84c6-a795874f0d69 req-c16c3b16-54b5-4923-b6b9-bead3c80970e service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Refreshing network info cache for port f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Start _get_guest_xml network_info=[{"id": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "address": "fa:16:3e:87:f2:b4", "network": {"id": "484f23e4-baa6-4c34-9913-4d79937ed2b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454098557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07419af6d6584e63b16a633a403c2a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b7c4e6-11", "ovs_interfaceid": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:05:50 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:05:50 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1508846477',display_name='tempest-DeleteServersTestJSON-server-1508846477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1508846477',id=24,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07419af6d6584e63b16a633a403c2a35',ramdisk_id='',reservation_id='r-y31x0f33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-168967147',owner_user_name='tempest-DeleteServersTestJSON-168967147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:05:48Z,user_data=None,user_id='33829eb577bb4ff1a509164d476b4f1d',uuid=923c2b29-3db6-4642-bbf0-e45c0ca6a2be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "address": "fa:16:3e:87:f2:b4", "network": {"id": "484f23e4-baa6-4c34-9913-4d79937ed2b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454098557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07419af6d6584e63b16a633a403c2a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b7c4e6-11", "ovs_interfaceid": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Converting VIF {"id": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "address": "fa:16:3e:87:f2:b4", "network": {"id": "484f23e4-baa6-4c34-9913-4d79937ed2b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454098557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07419af6d6584e63b16a633a403c2a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b7c4e6-11", "ovs_interfaceid": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=f4b7c4e6-115b-4b49-9e46-f3092bc8272d,network=Network(484f23e4-baa6-4c34-9913-4d79937ed2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b7c4e6-11') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.objects.instance [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lazy-loading 'pci_devices' on Instance uuid 923c2b29-3db6-4642-bbf0-e45c0ca6a2be {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:05:50 user nova-compute[73254]:   <uuid>923c2b29-3db6-4642-bbf0-e45c0ca6a2be</uuid>
Aug 14 15:05:50 user nova-compute[73254]:   <name>instance-00000018</name>
Aug 14 15:05:50 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:05:50 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:05:50 user nova-compute[73254]:   <metadata>
Aug 14 15:05:50 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:05:50 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:05:50 user nova-compute[73254]:       <nova:name>tempest-DeleteServersTestJSON-server-1508846477</nova:name>
Aug 14 15:05:50 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:05:50</nova:creationTime>
Aug 14 15:05:50 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:05:50 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:05:50 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:05:50 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:05:50 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:05:50 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:05:50 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:05:50 user nova-compute[73254]:       <nova:owner>
Aug 14 15:05:50 user nova-compute[73254]:         <nova:user uuid="33829eb577bb4ff1a509164d476b4f1d">tempest-DeleteServersTestJSON-168967147-project-member</nova:user>
Aug 14 15:05:50 user nova-compute[73254]:         <nova:project uuid="07419af6d6584e63b16a633a403c2a35">tempest-DeleteServersTestJSON-168967147</nova:project>
Aug 14 15:05:50 user nova-compute[73254]:       </nova:owner>
Aug 14 15:05:50 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:05:50 user nova-compute[73254]:       <nova:ports>
Aug 14 15:05:50 user nova-compute[73254]:         <nova:port uuid="f4b7c4e6-115b-4b49-9e46-f3092bc8272d">
Aug 14 15:05:50 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 15:05:50 user nova-compute[73254]:         </nova:port>
Aug 14 15:05:50 user nova-compute[73254]:       </nova:ports>
Aug 14 15:05:50 user nova-compute[73254]:     </nova:instance>
Aug 14 15:05:50 user nova-compute[73254]:   </metadata>
Aug 14 15:05:50 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:05:50 user nova-compute[73254]:     <system>
Aug 14 15:05:50 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:05:50 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:05:50 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:05:50 user nova-compute[73254]:       <entry name="serial">923c2b29-3db6-4642-bbf0-e45c0ca6a2be</entry>
Aug 14 15:05:50 user nova-compute[73254]:       <entry name="uuid">923c2b29-3db6-4642-bbf0-e45c0ca6a2be</entry>
Aug 14 15:05:50 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:05:50 user nova-compute[73254]:     </system>
Aug 14 15:05:50 user nova-compute[73254]:   </sysinfo>
Aug 14 15:05:50 user nova-compute[73254]:   <os>
Aug 14 15:05:50 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:05:50 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:05:50 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:05:50 user nova-compute[73254]:   </os>
Aug 14 15:05:50 user nova-compute[73254]:   <features>
Aug 14 15:05:50 user nova-compute[73254]:     <acpi/>
Aug 14 15:05:50 user nova-compute[73254]:     <apic/>
Aug 14 15:05:50 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:05:50 user nova-compute[73254]:   </features>
Aug 14 15:05:50 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:05:50 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:05:50 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:05:50 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:05:50 user nova-compute[73254]:   </clock>
Aug 14 15:05:50 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:05:50 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:05:50 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:05:50 user nova-compute[73254]:   </cpu>
Aug 14 15:05:50 user nova-compute[73254]:   <devices>
Aug 14 15:05:50 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:05:50 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:05:50 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk"/>
Aug 14 15:05:50 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:05:50 user nova-compute[73254]:     </disk>
Aug 14 15:05:50 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:05:50 user nova-compute[73254]:       <mac address="fa:16:3e:87:f2:b4"/>
Aug 14 15:05:50 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:05:50 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:05:50 user nova-compute[73254]:       <target dev="tapf4b7c4e6-11"/>
Aug 14 15:05:50 user nova-compute[73254]:     </interface>
Aug 14 15:05:50 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:05:50 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/console.log" append="off"/>
Aug 14 15:05:50 user nova-compute[73254]:     </serial>
Aug 14 15:05:50 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:05:50 user nova-compute[73254]:     <video>
Aug 14 15:05:50 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:05:50 user nova-compute[73254]:     </video>
Aug 14 15:05:50 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:05:50 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:05:50 user nova-compute[73254]:     </rng>
Aug 14 15:05:50 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:05:50 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:05:50 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:05:50 user nova-compute[73254]:     </memballoon>
Aug 14 15:05:50 user nova-compute[73254]:   </devices>
Aug 14 15:05:50 user nova-compute[73254]: </domain>
Aug 14 15:05:50 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1508846477',display_name='tempest-DeleteServersTestJSON-server-1508846477',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1508846477',id=24,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07419af6d6584e63b16a633a403c2a35',ramdisk_id='',reservation_id='r-y31x0f33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-168967147',owner_user_name='tempest-DeleteServersTestJSON-168967147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:05:48Z,user_data=None,user_id='33829eb577bb4ff1a509164d476b4f1d',uuid=923c2b29-3db6-4642-bbf0-e45c0ca6a2be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "address": "fa:16:3e:87:f2:b4", "network": {"id": "484f23e4-baa6-4c34-9913-4d79937ed2b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454098557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07419af6d6584e63b16a633a403c2a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b7c4e6-11", "ovs_interfaceid": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Converting VIF {"id": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "address": "fa:16:3e:87:f2:b4", "network": {"id": "484f23e4-baa6-4c34-9913-4d79937ed2b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454098557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07419af6d6584e63b16a633a403c2a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b7c4e6-11", "ovs_interfaceid": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=f4b7c4e6-115b-4b49-9e46-f3092bc8272d,network=Network(484f23e4-baa6-4c34-9913-4d79937ed2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b7c4e6-11') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG os_vif [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=f4b7c4e6-115b-4b49-9e46-f3092bc8272d,network=Network(484f23e4-baa6-4c34-9913-4d79937ed2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b7c4e6-11') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf4b7c4e6-11, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf4b7c4e6-11, col_values=(('external_ids', {'iface-id': 'f4b7c4e6-115b-4b49-9e46-f3092bc8272d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:f2:b4', 'vm-uuid': '923c2b29-3db6-4642-bbf0-e45c0ca6a2be'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:50 user nova-compute[73254]: INFO os_vif [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=f4b7c4e6-115b-4b49-9e46-f3092bc8272d,network=Network(484f23e4-baa6-4c34-9913-4d79937ed2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b7c4e6-11')
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:05:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] No VIF found with MAC fa:16:3e:87:f2:b4, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:05:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-4750457f-b83f-4b0a-84c6-a795874f0d69 req-c16c3b16-54b5-4923-b6b9-bead3c80970e service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Updated VIF entry in instance network info cache for port f4b7c4e6-115b-4b49-9e46-f3092bc8272d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:05:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-4750457f-b83f-4b0a-84c6-a795874f0d69 req-c16c3b16-54b5-4923-b6b9-bead3c80970e service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Updating instance_info_cache with network_info: [{"id": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "address": "fa:16:3e:87:f2:b4", "network": {"id": "484f23e4-baa6-4c34-9913-4d79937ed2b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454098557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07419af6d6584e63b16a633a403c2a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b7c4e6-11", "ovs_interfaceid": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:05:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4750457f-b83f-4b0a-84c6-a795874f0d69 req-c16c3b16-54b5-4923-b6b9-bead3c80970e service nova] Releasing lock "refresh_cache-923c2b29-3db6-4642-bbf0-e45c0ca6a2be" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:05:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-3a3ca6f5-bab5-4296-897b-035933242834 req-b5e03cb3-1f0a-4a14-a9e8-4f33cf3493ee service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Received event network-vif-plugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3a3ca6f5-bab5-4296-897b-035933242834 req-b5e03cb3-1f0a-4a14-a9e8-4f33cf3493ee service nova] Acquiring lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3a3ca6f5-bab5-4296-897b-035933242834 req-b5e03cb3-1f0a-4a14-a9e8-4f33cf3493ee service nova] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3a3ca6f5-bab5-4296-897b-035933242834 req-b5e03cb3-1f0a-4a14-a9e8-4f33cf3493ee service nova] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-3a3ca6f5-bab5-4296-897b-035933242834 req-b5e03cb3-1f0a-4a14-a9e8-4f33cf3493ee service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] No waiting events found dispatching network-vif-plugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:05:52 user nova-compute[73254]: WARNING nova.compute.manager [req-3a3ca6f5-bab5-4296-897b-035933242834 req-b5e03cb3-1f0a-4a14-a9e8-4f33cf3493ee service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Received unexpected event network-vif-plugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d for instance with vm_state building and task_state spawning.
Aug 14 15:05:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-13ce896a-aeb7-43ad-a7f6-96cd718713e5 req-aaf49346-7c8e-401d-a71c-0e8553c20834 service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Received event network-vif-plugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-13ce896a-aeb7-43ad-a7f6-96cd718713e5 req-aaf49346-7c8e-401d-a71c-0e8553c20834 service nova] Acquiring lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-13ce896a-aeb7-43ad-a7f6-96cd718713e5 req-aaf49346-7c8e-401d-a71c-0e8553c20834 service nova] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-13ce896a-aeb7-43ad-a7f6-96cd718713e5 req-aaf49346-7c8e-401d-a71c-0e8553c20834 service nova] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-13ce896a-aeb7-43ad-a7f6-96cd718713e5 req-aaf49346-7c8e-401d-a71c-0e8553c20834 service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] No waiting events found dispatching network-vif-plugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:05:54 user nova-compute[73254]: WARNING nova.compute.manager [req-13ce896a-aeb7-43ad-a7f6-96cd718713e5 req-aaf49346-7c8e-401d-a71c-0e8553c20834 service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Received unexpected event network-vif-plugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d for instance with vm_state building and task_state spawning.
Aug 14 15:05:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025554.48675, 923c2b29-3db6-4642-bbf0-e45c0ca6a2be => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:05:54 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] VM Resumed (Lifecycle Event)
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:54 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Instance spawned successfully.
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:05:54 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025554.4881577, 923c2b29-3db6-4642-bbf0-e45c0ca6a2be => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:05:54 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] VM Started (Lifecycle Event)
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:05:54 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:05:54 user nova-compute[73254]: INFO nova.compute.manager [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Took 6.06 seconds to spawn the instance on the hypervisor.
Aug 14 15:05:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:54 user nova-compute[73254]: INFO nova.compute.manager [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Took 7.13 seconds to build instance.
Aug 14 15:05:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-33024f3b-af0b-49e4-a11b-e054d5fd52ab tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.272s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:05:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:05:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:05:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:05:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:05:58 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-8f5eae28-ab9d-4ec7-8f61-0f76e9f34127 req-b89aea61-75cd-4e70-90bc-0ad958a7def7 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received event network-changed-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-8f5eae28-ab9d-4ec7-8f61-0f76e9f34127 req-b89aea61-75cd-4e70-90bc-0ad958a7def7 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Refreshing instance network info cache due to event network-changed-ff00cec3-b5d9-4058-ae5b-bbe4087333e9. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8f5eae28-ab9d-4ec7-8f61-0f76e9f34127 req-b89aea61-75cd-4e70-90bc-0ad958a7def7 service nova] Acquiring lock "refresh_cache-714586d7-babb-49e0-b2bd-e07cf4f47849" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8f5eae28-ab9d-4ec7-8f61-0f76e9f34127 req-b89aea61-75cd-4e70-90bc-0ad958a7def7 service nova] Acquired lock "refresh_cache-714586d7-babb-49e0-b2bd-e07cf4f47849" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG nova.network.neutron [req-8f5eae28-ab9d-4ec7-8f61-0f76e9f34127 req-b89aea61-75cd-4e70-90bc-0ad958a7def7 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Refreshing network info cache for port ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025544.904122, 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:05:59 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] VM Stopped (Lifecycle Event)
Aug 14 15:05:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7d7c2f20-ed28-40de-aab5-d2b4e11973a3 None None] [instance: 81b7d46d-1e0f-4f42-9210-7fbcf6a41cd7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:05:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG nova.network.neutron [req-8f5eae28-ab9d-4ec7-8f61-0f76e9f34127 req-b89aea61-75cd-4e70-90bc-0ad958a7def7 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Updated VIF entry in instance network info cache for port ff00cec3-b5d9-4058-ae5b-bbe4087333e9. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG nova.network.neutron [req-8f5eae28-ab9d-4ec7-8f61-0f76e9f34127 req-b89aea61-75cd-4e70-90bc-0ad958a7def7 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Updating instance_info_cache with network_info: [{"id": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "address": "fa:16:3e:ca:3b:92", "network": {"id": "f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-902012879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e6a52f6944d42c083829538f3bc1016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff00cec3-b5", "ovs_interfaceid": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8f5eae28-ab9d-4ec7-8f61-0f76e9f34127 req-b89aea61-75cd-4e70-90bc-0ad958a7def7 service nova] Releasing lock "refresh_cache-714586d7-babb-49e0-b2bd-e07cf4f47849" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lazy-loading 'flavor' on Instance uuid 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:06:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:01 user nova-compute[73254]: INFO nova.compute.manager [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Attaching volume d486316f-a8c6-45c8-92fc-130ce931329e to /dev/vdb
Aug 14 15:06:01 user nova-compute[73254]: DEBUG os_brick.utils [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b7a6d1-8aa7-4ab9-bb8b-4c3576743924]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9b3ae2-c5e7-4003-828e-3f433c40fd99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[074ea0eb-72d6-488b-a7ca-876a33765982]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[485496cf-f320-4618-8afe-a4f8f7ec656b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:06:01 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65185d7-b6e6-4058-b26a-35c057f4e77c]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG os_brick.utils [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] <== get_connector_properties: return (237ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Updating existing volume attachment record: 39103a56-173a-4843-b88a-1e8f477d1f90 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.248s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.271s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-ea3d771e-fc28-4b3d-aff5-43e3d8628d5c req-76487fb2-2251-4b9e-a410-6c475f093bba service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received event network-changed-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-ea3d771e-fc28-4b3d-aff5-43e3d8628d5c req-76487fb2-2251-4b9e-a410-6c475f093bba service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Refreshing instance network info cache due to event network-changed-4998f987-9e07-4317-b1b0-b0ee6c7cb815. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ea3d771e-fc28-4b3d-aff5-43e3d8628d5c req-76487fb2-2251-4b9e-a410-6c475f093bba service nova] Acquiring lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ea3d771e-fc28-4b3d-aff5-43e3d8628d5c req-76487fb2-2251-4b9e-a410-6c475f093bba service nova] Acquired lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG nova.network.neutron [req-ea3d771e-fc28-4b3d-aff5-43e3d8628d5c req-76487fb2-2251-4b9e-a410-6c475f093bba service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Refreshing network info cache for port 4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:04 user nova-compute[73254]: INFO nova.compute.manager [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Terminating instance
Aug 14 15:06:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:05 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:06:05 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:06:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=6940MB free_disk=25.220680236816406GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Instance destroyed successfully.
Aug 14 15:06:05 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'resources' on Instance uuid 83808001-6b81-4479-86ff-94bb588d22fd {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:03:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1382794950',display_name='tempest-TestStampPattern-server-1382794950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1382794950',id=18,image_ref='177fdb93-c2a2-4827-8bfe-2b3dbe9250db',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaEzkBahIJ840YexSkejfPgB8Zu9IUTn4OhhFXFVyR7pO7f5lGzuSbxZ+sWUWa5xUvNWxRoCjcERWwoKcS9+q8odyZhEZxgpj4xugZIhdTa72+xL2CIyBYVuUyoIrEWBQ==',key_name='tempest-TestStampPattern-568033608',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7178e5b9b71a485ca1341c171795379e',ramdisk_id='',reservation_id='r-a2gind3e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='4b878d88-e5f3-41b9-a399-c2da1806e1fc',image_min_disk='1',image_min_ram='0',image_owner_id='7178e5b9b71a485ca1341c171795379e',image_owner_project_name='tempest-TestStampPattern-1384631137',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1384631137-project-member',image_user_id='473f1026828f41cc810fb66cf3715daf',owner_project_name='tempest-TestStampPattern-1384631137',owner_user_name='tempest-TestStampPattern-1384631137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:03:18Z,user_data=None,user_id='473f1026828f41cc810fb66cf3715daf',uuid=83808001-6b81-4479-86ff-94bb588d22fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converting VIF {"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=4998f987-9e07-4317-b1b0-b0ee6c7cb815,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4998f987-9e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG os_vif [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=4998f987-9e07-4317-b1b0-b0ee6c7cb815,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4998f987-9e') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4998f987-9e, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:06:05 user nova-compute[73254]: INFO os_vif [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:d1:85,bridge_name='br-int',has_traffic_filtering=True,id=4998f987-9e07-4317-b1b0-b0ee6c7cb815,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4998f987-9e')
Aug 14 15:06:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Deleting instance files /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd_del
Aug 14 15:06:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Deletion of /opt/stack/data/nova/instances/83808001-6b81-4479-86ff-94bb588d22fd_del complete
Aug 14 15:06:06 user nova-compute[73254]: INFO nova.compute.manager [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 16996b6c-6d6e-4b51-88f3-0ca024e95639 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0110dafc-b336-45bd-aade-0eb9ba632a05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 83808001-6b81-4479-86ff-94bb588d22fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 714586d7-babb-49e0-b2bd-e07cf4f47849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 456882f8-f70c-4a85-b593-c1066e732a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 01773c99-e739-4da9-8c0b-493556a46e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 923c2b29-3db6-4642-bbf0-e45c0ca6a2be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-ea3d771e-fc28-4b3d-aff5-43e3d8628d5c req-76487fb2-2251-4b9e-a410-6c475f093bba service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Updated VIF entry in instance network info cache for port 4998f987-9e07-4317-b1b0-b0ee6c7cb815. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-ea3d771e-fc28-4b3d-aff5-43e3d8628d5c req-76487fb2-2251-4b9e-a410-6c475f093bba service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Updating instance_info_cache with network_info: [{"id": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "address": "fa:16:3e:27:d1:85", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4998f987-9e", "ovs_interfaceid": "4998f987-9e07-4317-b1b0-b0ee6c7cb815", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ea3d771e-fc28-4b3d-aff5-43e3d8628d5c req-76487fb2-2251-4b9e-a410-6c475f093bba service nova] Releasing lock "refresh_cache-83808001-6b81-4479-86ff-94bb588d22fd" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.708s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received event network-vif-unplugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] Lock "83808001-6b81-4479-86ff-94bb588d22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] Lock "83808001-6b81-4479-86ff-94bb588d22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] No waiting events found dispatching network-vif-unplugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received event network-vif-unplugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received event network-vif-plugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] Acquiring lock "83808001-6b81-4479-86ff-94bb588d22fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] Lock "83808001-6b81-4479-86ff-94bb588d22fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] Lock "83808001-6b81-4479-86ff-94bb588d22fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] No waiting events found dispatching network-vif-plugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:06:06 user nova-compute[73254]: WARNING nova.compute.manager [req-acf8b2c9-c70b-4761-aa51-180db40ebcaf req-86c99da3-bca5-4cd4-b6fe-ee1d2a7185d6 service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received unexpected event network-vif-plugged-4998f987-9e07-4317-b1b0-b0ee6c7cb815 for instance with vm_state active and task_state deleting.
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-fd0cfc05-b945-4e54-88e3-7cda3258b13b req-7f6ea367-48a8-44e5-b7da-7393018ab3bc service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Received event network-vif-deleted-4998f987-9e07-4317-b1b0-b0ee6c7cb815 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:06 user nova-compute[73254]: INFO nova.compute.manager [req-fd0cfc05-b945-4e54-88e3-7cda3258b13b req-7f6ea367-48a8-44e5-b7da-7393018ab3bc service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Neutron deleted interface 4998f987-9e07-4317-b1b0-b0ee6c7cb815; detaching it from the instance and deleting it from the info cache
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-fd0cfc05-b945-4e54-88e3-7cda3258b13b req-7f6ea367-48a8-44e5-b7da-7393018ab3bc service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:06:06 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Took 0.68 seconds to deallocate network for instance.
Aug 14 15:06:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-fd0cfc05-b945-4e54-88e3-7cda3258b13b req-7f6ea367-48a8-44e5-b7da-7393018ab3bc service nova] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Detach interface failed, port_id=4998f987-9e07-4317-b1b0-b0ee6c7cb815, reason: Instance 83808001-6b81-4479-86ff-94bb588d22fd could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:07 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:06:07 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:06:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.474s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:07 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Deleted allocations for instance 83808001-6b81-4479-86ff-94bb588d22fd
Aug 14 15:06:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6d04907e-c3cf-4c08-9721-5bd3681bbc2c tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "83808001-6b81-4479-86ff-94bb588d22fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.636s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:06:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:06:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:06:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:06:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:06:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:06:07 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:06:08 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance_info_cache with network_info: [{"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:06:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-0110dafc-b336-45bd-aade-0eb9ba632a05" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:06:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:06:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:06:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:06:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:06:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:06:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:06:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:06:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:06:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkzLKxcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:06:11 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:06:11 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:06:11 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da52650-c8c1-46fc-8df6-1f547e1ef300]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:06:11 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c5235c-6bae-4b00-b053-ccef1ae816c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e] added
Aug 14 15:06:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6c6833-acb0-482e-a1f4-c3799e55930b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fcaebd-c835-492f-9b08-d9aea8025538]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkzLKxcY {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qkzLKxcY" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[46dbc513-049d-4eaf-acf8-12d0a4d3c941]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qkzLKxcY'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5012198f-1a93-4077-bd08-51c03555b42b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccce99a-0c8a-4498-ad57-7f467cbd522b]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ed9821-7d0c-42eb-848a-c93b031cd75b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e, portal: 172.16.0.220,3260]
Aug 14 15:06:11 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e, portal: 172.16.0.220,3260] successful.
Aug 14 15:06:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbdeff3-4db3-4865-8a71-8131541dfc8a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac5b7b5-d2e5-4953-bd4d-c48aabff1f65]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:11 user nova-compute[73254]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:06:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:11 user nova-compute[73254]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:06:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d090639-2dca-4c9f-bcbb-ac93bce99be8]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:06:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkzLKxcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:06:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:06:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23638383230373832', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:06:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638383230373832', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:06:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lazy-loading 'flavor' on Instance uuid 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:06:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:06:12 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:06:12 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:06:12 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:06:12 user nova-compute[73254]:   <serial>d486316f-a8c6-45c8-92fc-130ce931329e</serial>
Aug 14 15:06:12 user nova-compute[73254]: </disk>
Aug 14 15:06:12 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:06:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:06:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:06:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] No VIF found with MAC fa:16:3e:ca:3b:92, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:06:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6491a298-d29e-4780-9bf6-69cb9229285b tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.325s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG nova.objects.instance [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lazy-loading 'flavor' on Instance uuid 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:17 user nova-compute[73254]: INFO nova.compute.manager [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Attaching volume 2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d to /dev/vdc
Aug 14 15:06:17 user nova-compute[73254]: DEBUG os_brick.utils [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe98763-a639-4ddd-9fb1-1601b6f6286c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6703077-d563-41ef-9c8c-fb9f870ad737]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9962970f-58a4-4ed9-9294-0314b15b38aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb00e0c-bc9c-4015-9833-dfc54fc7adab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:06:17 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:06:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[deae9195-99b7-4006-a1e5-e14394abe159]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG os_brick.utils [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:06:17 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Updating existing volume attachment record: 946bf8d4-b505-458a-9644-98db591f7e63 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:06:20 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025565.678414, 83808001-6b81-4479-86ff-94bb588d22fd => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:06:20 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] VM Stopped (Lifecycle Event)
Aug 14 15:06:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6913e37f-8510-45fa-a857-1cc8fc4daf16 None None] [instance: 83808001-6b81-4479-86ff-94bb588d22fd] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:06:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsxjEJyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:06:25 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:06:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:06:25 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:06:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:06:25 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:06:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df51578-ca50-495d-82f7-dc029fb330ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:06:25 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cec348d-bd13-4ab5-beda-ff6e06d78771]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d] added
Aug 14 15:06:25 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[37374ab8-01a4-45c8-b7f0-bc3dfec753e5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[193530da-e65a-4df0-b1a8-7186f1c2a2d3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nsxjEJyk {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nsxjEJyk" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac8f7dc-6777-4c38-8969-32d336113888]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nsxjEJyk'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae0342d-2895-429b-b2c2-e208925ea85e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c443628a-0920-4ae5-b01a-3859a02116d9]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:26 user nova-compute[73254]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:06:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:26 user nova-compute[73254]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:06:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1908626-9bab-4ab7-b75c-dd66412607fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d, portal: 172.16.0.220,3260]
Aug 14 15:06:26 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d, portal: 172.16.0.220,3260] successful.
Aug 14 15:06:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8f3fe5-fc0f-40b2-95f2-5eaad71019b4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47b88d0-11e6-41b4-bae5-8a71c4b83570]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:26 user nova-compute[73254]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:06:26 user nova-compute[73254]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d (non-flash)
Aug 14 15:06:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:26 user nova-compute[73254]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:06:26 user nova-compute[73254]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d (non-flash)
Aug 14 15:06:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d10144-1bb2-4987-a0dd-9107a7e5358c]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsxjEJyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:06:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:06:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23439346565393832', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:06:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439346565393832', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:06:27 user nova-compute[73254]: DEBUG nova.objects.instance [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lazy-loading 'flavor' on Instance uuid 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:06:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:06:27 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:06:27 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:06:27 user nova-compute[73254]:   <target dev="vdc" bus="virtio"/>
Aug 14 15:06:27 user nova-compute[73254]:   <serial>2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d</serial>
Aug 14 15:06:27 user nova-compute[73254]: </disk>
Aug 14 15:06:27 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:06:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:06:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:06:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:06:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] No VIF found with MAC fa:16:3e:ca:3b:92, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:06:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-271c7c48-a1c0-4d4b-bd5f-b00a078c1bed tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.552s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:28 user nova-compute[73254]: INFO nova.compute.manager [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Detaching volume 2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d
Aug 14 15:06:28 user nova-compute[73254]: INFO nova.virt.block_device [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Attempting to driver detach volume 2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d from mountpoint /dev/vdc
Aug 14 15:06:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Attempting to detach device vdc from instance 714586d7-babb-49e0-b2bd-e07cf4f47849 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:06:28 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:06:28 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:06:28 user nova-compute[73254]:   <target dev="vdc" bus="virtio"/>
Aug 14 15:06:28 user nova-compute[73254]:   <serial>2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d</serial>
Aug 14 15:06:28 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 15:06:28 user nova-compute[73254]: </disk>
Aug 14 15:06:28 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:06:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Successfully detached device vdc from instance 714586d7-babb-49e0-b2bd-e07cf4f47849 from the persistent domain config.
Aug 14 15:06:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 714586d7-babb-49e0-b2bd-e07cf4f47849 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:06:28 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:06:28 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:06:28 user nova-compute[73254]:   <target dev="vdc" bus="virtio"/>
Aug 14 15:06:28 user nova-compute[73254]:   <serial>2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d</serial>
Aug 14 15:06:28 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 15:06:28 user nova-compute[73254]: </disk>
Aug 14 15:06:28 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025588.7576337, 714586d7-babb-49e0-b2bd-e07cf4f47849 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:06:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Successfully detached device vdc from instance 714586d7-babb-49e0-b2bd-e07cf4f47849 from the live domain config.
Aug 14 15:06:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nsxjEJyk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:06:28 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf9a965-5697-42a7-9149-89c233baaa99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[090fcd85-04c9-4440-bef0-fe968f5d7323]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:28 user nova-compute[73254]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:06:28 user nova-compute[73254]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d (non-flash)
Aug 14 15:06:28 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:28 user nova-compute[73254]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:06:28 user nova-compute[73254]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d (non-flash)
Aug 14 15:06:28 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64859d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d'): ({'sdd'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Removing single pathed devices sdd {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abdd310-61dd-4776-bb14-0a5ad466ec49]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d0a06f-2564-4976-84bd-a3bc32611f7c]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Flushing IO for device /dev/sdd {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa25df7-9603-4541-aed1-5cb4aad0e078]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0471112-2b2a-47f4-b056-ed8c61c681e6]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0919e1f7-fc53-4750-8f43-081fda1e4144]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[965f92e4-afe5-40f4-ba82-e3c3f937b7fe]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d, portal: 172.16.0.220,3260]
Aug 14 15:06:29 user nova-compute[73254]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d, portal: 172.16.0.220,3260] successful.
Aug 14 15:06:29 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a713b6a-a7a7-4f4c-ac7f-5fbe0f90de8d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90b1151-2aa5-4f20-aed7-42326ce41578]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] <== disconnect_volume: return (298ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG nova.objects.instance [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lazy-loading 'flavor' on Instance uuid 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:06:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-11647dd7-a761-4e21-b18d-c1f8b1d25e51 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.655s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:38 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:06:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:06:38 user nova-compute[73254]: INFO nova.compute.claims [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Claim successful on node user
Aug 14 15:06:38 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:06:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:06:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:38 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:06:39 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:06:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG nova.policy [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55b05671f1cb4c05a7bedb3559968162', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '038244b91aad403897eb49752db371e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:06:39 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Creating image(s)
Aug 14 15:06:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "/opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "/opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "/opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2.part --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Successfully created port: 2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2.part --force-share --output=json" returned: 0 in 0.283s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG nova.virt.images [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] 05987b15-e599-4a59-86d2-2b01be76728c was qcow2, converting to raw {{(pid=73254) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:06:39 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2.part /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2.converted {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2.part /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2.converted" returned: 0 in 0.496s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2.converted --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.409s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2 --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Successfully updated port: 2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-2c0e7542-8a9f-418c-a46f-cba83364eae7 req-b34da822-68c7-4066-a22c-2709822306fa service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-changed-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-2c0e7542-8a9f-418c-a46f-cba83364eae7 req-b34da822-68c7-4066-a22c-2709822306fa service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Refreshing instance network info cache due to event network-changed-2ec17370-cd59-4a47-ba00-ad12c2c4dc25. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2c0e7542-8a9f-418c-a46f-cba83364eae7 req-b34da822-68c7-4066-a22c-2709822306fa service nova] Acquiring lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2c0e7542-8a9f-418c-a46f-cba83364eae7 req-b34da822-68c7-4066-a22c-2709822306fa service nova] Acquired lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG nova.network.neutron [req-2c0e7542-8a9f-418c-a46f-cba83364eae7 req-b34da822-68c7-4066-a22c-2709822306fa service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Refreshing network info cache for port 2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG nova.network.neutron [req-2c0e7542-8a9f-418c-a46f-cba83364eae7 req-b34da822-68c7-4066-a22c-2709822306fa service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2 --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2,backing_fmt=raw /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2,backing_fmt=raw /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk 1073741824" returned: 0 in 0.061s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.network.neutron [req-2c0e7542-8a9f-418c-a46f-cba83364eae7 req-b34da822-68c7-4066-a22c-2709822306fa service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2c0e7542-8a9f-418c-a46f-cba83364eae7 req-b34da822-68c7-4066-a22c-2709822306fa service nova] Releasing lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquired lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2 --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Cannot resize image /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'migration_context' on Instance uuid 35c77333-bc2c-429b-a65f-dd87ae2bfe25 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Ensure instance console log exists: /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updating instance_info_cache with network_info: [{"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Releasing lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Instance network_info: |[{"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Start _get_guest_xml network_info=[{"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T15:06:35Z,direct_url=<?>,disk_format='qcow2',id=05987b15-e599-4a59-86d2-2b01be76728c,min_disk=0,min_ram=0,name='tempest-scenario-img--730545761',owner='038244b91aad403897eb49752db371e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T15:06:37Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '05987b15-e599-4a59-86d2-2b01be76728c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:06:41 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:06:41 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T15:06:35Z,direct_url=<?>,disk_format='qcow2',id=05987b15-e599-4a59-86d2-2b01be76728c,min_disk=0,min_ram=0,name='tempest-scenario-img--730545761',owner='038244b91aad403897eb49752db371e7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T15:06:37Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2094262818',display_name='tempest-TestMinimumBasicScenario-server-2094262818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2094262818',id=25,image_ref='05987b15-e599-4a59-86d2-2b01be76728c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6s1as0uqOq9fN8AX4w1eK6nn4PyYEQB3qKjMqpWeSQlKKNONVC9oU0QkMZNzfCqtsjbMJK2lQOqLvuXEbwQcquiV/XY7Kp6pxHL9VA4jjLZoVrPLwgJXjzxMzdH85oRg==',key_name='tempest-TestMinimumBasicScenario-152339947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='038244b91aad403897eb49752db371e7',ramdisk_id='',reservation_id='r-2uhhej6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='05987b15-e599-4a59-86d2-2b01be76728c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-270556114',owner_user_name='tempest-TestMinimumBasicScenario-270556114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:06:39Z,user_data=None,user_id='55b05671f1cb4c05a7bedb3559968162',uuid=35c77333-bc2c-429b-a65f-dd87ae2bfe25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converting VIF {"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:39:12,bridge_name='br-int',has_traffic_filtering=True,id=2ec17370-cd59-4a47-ba00-ad12c2c4dc25,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec17370-cd') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'pci_devices' on Instance uuid 35c77333-bc2c-429b-a65f-dd87ae2bfe25 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:06:41 user nova-compute[73254]:   <uuid>35c77333-bc2c-429b-a65f-dd87ae2bfe25</uuid>
Aug 14 15:06:41 user nova-compute[73254]:   <name>instance-00000019</name>
Aug 14 15:06:41 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:06:41 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:06:41 user nova-compute[73254]:   <metadata>
Aug 14 15:06:41 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:06:41 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:06:41 user nova-compute[73254]:       <nova:name>tempest-TestMinimumBasicScenario-server-2094262818</nova:name>
Aug 14 15:06:41 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:06:41</nova:creationTime>
Aug 14 15:06:41 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:06:41 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:06:41 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:06:41 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:06:41 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:06:41 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:06:41 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:06:41 user nova-compute[73254]:       <nova:owner>
Aug 14 15:06:41 user nova-compute[73254]:         <nova:user uuid="55b05671f1cb4c05a7bedb3559968162">tempest-TestMinimumBasicScenario-270556114-project-member</nova:user>
Aug 14 15:06:41 user nova-compute[73254]:         <nova:project uuid="038244b91aad403897eb49752db371e7">tempest-TestMinimumBasicScenario-270556114</nova:project>
Aug 14 15:06:41 user nova-compute[73254]:       </nova:owner>
Aug 14 15:06:41 user nova-compute[73254]:       <nova:root type="image" uuid="05987b15-e599-4a59-86d2-2b01be76728c"/>
Aug 14 15:06:41 user nova-compute[73254]:       <nova:ports>
Aug 14 15:06:41 user nova-compute[73254]:         <nova:port uuid="2ec17370-cd59-4a47-ba00-ad12c2c4dc25">
Aug 14 15:06:41 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 15:06:41 user nova-compute[73254]:         </nova:port>
Aug 14 15:06:41 user nova-compute[73254]:       </nova:ports>
Aug 14 15:06:41 user nova-compute[73254]:     </nova:instance>
Aug 14 15:06:41 user nova-compute[73254]:   </metadata>
Aug 14 15:06:41 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:06:41 user nova-compute[73254]:     <system>
Aug 14 15:06:41 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:06:41 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:06:41 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:06:41 user nova-compute[73254]:       <entry name="serial">35c77333-bc2c-429b-a65f-dd87ae2bfe25</entry>
Aug 14 15:06:41 user nova-compute[73254]:       <entry name="uuid">35c77333-bc2c-429b-a65f-dd87ae2bfe25</entry>
Aug 14 15:06:41 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:06:41 user nova-compute[73254]:     </system>
Aug 14 15:06:41 user nova-compute[73254]:   </sysinfo>
Aug 14 15:06:41 user nova-compute[73254]:   <os>
Aug 14 15:06:41 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:06:41 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:06:41 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:06:41 user nova-compute[73254]:   </os>
Aug 14 15:06:41 user nova-compute[73254]:   <features>
Aug 14 15:06:41 user nova-compute[73254]:     <acpi/>
Aug 14 15:06:41 user nova-compute[73254]:     <apic/>
Aug 14 15:06:41 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:06:41 user nova-compute[73254]:   </features>
Aug 14 15:06:41 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:06:41 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:06:41 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:06:41 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:06:41 user nova-compute[73254]:   </clock>
Aug 14 15:06:41 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:06:41 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:06:41 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:06:41 user nova-compute[73254]:   </cpu>
Aug 14 15:06:41 user nova-compute[73254]:   <devices>
Aug 14 15:06:41 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:06:41 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:06:41 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk"/>
Aug 14 15:06:41 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:06:41 user nova-compute[73254]:     </disk>
Aug 14 15:06:41 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:06:41 user nova-compute[73254]:       <mac address="fa:16:3e:43:39:12"/>
Aug 14 15:06:41 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:06:41 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:06:41 user nova-compute[73254]:       <target dev="tap2ec17370-cd"/>
Aug 14 15:06:41 user nova-compute[73254]:     </interface>
Aug 14 15:06:41 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:06:41 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/console.log" append="off"/>
Aug 14 15:06:41 user nova-compute[73254]:     </serial>
Aug 14 15:06:41 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:06:41 user nova-compute[73254]:     <video>
Aug 14 15:06:41 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:06:41 user nova-compute[73254]:     </video>
Aug 14 15:06:41 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:06:41 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:06:41 user nova-compute[73254]:     </rng>
Aug 14 15:06:41 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:06:41 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:06:41 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:06:41 user nova-compute[73254]:     </memballoon>
Aug 14 15:06:41 user nova-compute[73254]:   </devices>
Aug 14 15:06:41 user nova-compute[73254]: </domain>
Aug 14 15:06:41 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2094262818',display_name='tempest-TestMinimumBasicScenario-server-2094262818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2094262818',id=25,image_ref='05987b15-e599-4a59-86d2-2b01be76728c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6s1as0uqOq9fN8AX4w1eK6nn4PyYEQB3qKjMqpWeSQlKKNONVC9oU0QkMZNzfCqtsjbMJK2lQOqLvuXEbwQcquiV/XY7Kp6pxHL9VA4jjLZoVrPLwgJXjzxMzdH85oRg==',key_name='tempest-TestMinimumBasicScenario-152339947',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='038244b91aad403897eb49752db371e7',ramdisk_id='',reservation_id='r-2uhhej6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='05987b15-e599-4a59-86d2-2b01be76728c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-270556114',owner_user_name='tempest-TestMinimumBasicScenario-270556114-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:06:39Z,user_data=None,user_id='55b05671f1cb4c05a7bedb3559968162',uuid=35c77333-bc2c-429b-a65f-dd87ae2bfe25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converting VIF {"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:39:12,bridge_name='br-int',has_traffic_filtering=True,id=2ec17370-cd59-4a47-ba00-ad12c2c4dc25,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec17370-cd') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG os_vif [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:39:12,bridge_name='br-int',has_traffic_filtering=True,id=2ec17370-cd59-4a47-ba00-ad12c2c4dc25,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec17370-cd') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ec17370-cd, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2ec17370-cd, col_values=(('external_ids', {'iface-id': '2ec17370-cd59-4a47-ba00-ad12c2c4dc25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:39:12', 'vm-uuid': '35c77333-bc2c-429b-a65f-dd87ae2bfe25'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:41 user nova-compute[73254]: INFO os_vif [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:39:12,bridge_name='br-int',has_traffic_filtering=True,id=2ec17370-cd59-4a47-ba00-ad12c2c4dc25,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec17370-cd')
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:06:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] No VIF found with MAC fa:16:3e:43:39:12, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:06:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-768efecf-efb8-4e58-8b24-43450ac118fe req-b9971319-0002-440a-9275-66c52cb9fbc3 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-768efecf-efb8-4e58-8b24-43450ac118fe req-b9971319-0002-440a-9275-66c52cb9fbc3 service nova] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-768efecf-efb8-4e58-8b24-43450ac118fe req-b9971319-0002-440a-9275-66c52cb9fbc3 service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-768efecf-efb8-4e58-8b24-43450ac118fe req-b9971319-0002-440a-9275-66c52cb9fbc3 service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-768efecf-efb8-4e58-8b24-43450ac118fe req-b9971319-0002-440a-9275-66c52cb9fbc3 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] No waiting events found dispatching network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:06:43 user nova-compute[73254]: WARNING nova.compute.manager [req-768efecf-efb8-4e58-8b24-43450ac118fe req-b9971319-0002-440a-9275-66c52cb9fbc3 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received unexpected event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 for instance with vm_state building and task_state spawning.
Aug 14 15:06:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025605.1572475, 35c77333-bc2c-429b-a65f-dd87ae2bfe25 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:06:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] VM Resumed (Lifecycle Event)
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:06:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Instance spawned successfully.
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:06:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025605.1624615, 35c77333-bc2c-429b-a65f-dd87ae2bfe25 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:06:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] VM Started (Lifecycle Event)
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a716c69-ba2d-47e4-8073-703fa98aa039 req-9b5b2054-9ef2-43fe-98f9-83cc32b892cd service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a716c69-ba2d-47e4-8073-703fa98aa039 req-9b5b2054-9ef2-43fe-98f9-83cc32b892cd service nova] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a716c69-ba2d-47e4-8073-703fa98aa039 req-9b5b2054-9ef2-43fe-98f9-83cc32b892cd service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a716c69-ba2d-47e4-8073-703fa98aa039 req-9b5b2054-9ef2-43fe-98f9-83cc32b892cd service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a716c69-ba2d-47e4-8073-703fa98aa039 req-9b5b2054-9ef2-43fe-98f9-83cc32b892cd service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] No waiting events found dispatching network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:06:45 user nova-compute[73254]: WARNING nova.compute.manager [req-6a716c69-ba2d-47e4-8073-703fa98aa039 req-9b5b2054-9ef2-43fe-98f9-83cc32b892cd service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received unexpected event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 for instance with vm_state building and task_state spawning.
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:06:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:06:45 user nova-compute[73254]: INFO nova.compute.manager [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Took 6.27 seconds to spawn the instance on the hypervisor.
Aug 14 15:06:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:06:45 user nova-compute[73254]: INFO nova.compute.manager [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Took 7.12 seconds to build instance.
Aug 14 15:06:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a2f325c-f607-4cc6-b6e7-6d7f93a64450 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.222s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "16996b6c-6d6e-4b51-88f3-0ca024e95639" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:56 user nova-compute[73254]: INFO nova.compute.manager [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Terminating instance
Aug 14 15:06:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:56 user nova-compute[73254]: INFO nova.compute.manager [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Terminating instance
Aug 14 15:06:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-5a835227-6475-46d2-b603-c73dab72c72c req-5d6dac89-5136-4449-881c-00800a6aed53 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-unplugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5a835227-6475-46d2-b603-c73dab72c72c req-5d6dac89-5136-4449-881c-00800a6aed53 service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5a835227-6475-46d2-b603-c73dab72c72c req-5d6dac89-5136-4449-881c-00800a6aed53 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5a835227-6475-46d2-b603-c73dab72c72c req-5d6dac89-5136-4449-881c-00800a6aed53 service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-5a835227-6475-46d2-b603-c73dab72c72c req-5d6dac89-5136-4449-881c-00800a6aed53 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-unplugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:06:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-5a835227-6475-46d2-b603-c73dab72c72c req-5d6dac89-5136-4449-881c-00800a6aed53 service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-unplugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-08460b77-c16f-4ec4-9297-45e8efda2ad4 req-27c9043f-a44b-4b4b-b017-a88769c2cbc9 service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Received event network-vif-unplugged-c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-08460b77-c16f-4ec4-9297-45e8efda2ad4 req-27c9043f-a44b-4b4b-b017-a88769c2cbc9 service nova] Acquiring lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-08460b77-c16f-4ec4-9297-45e8efda2ad4 req-27c9043f-a44b-4b4b-b017-a88769c2cbc9 service nova] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-08460b77-c16f-4ec4-9297-45e8efda2ad4 req-27c9043f-a44b-4b4b-b017-a88769c2cbc9 service nova] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-08460b77-c16f-4ec4-9297-45e8efda2ad4 req-27c9043f-a44b-4b4b-b017-a88769c2cbc9 service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] No waiting events found dispatching network-vif-unplugged-c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-08460b77-c16f-4ec4-9297-45e8efda2ad4 req-27c9043f-a44b-4b4b-b017-a88769c2cbc9 service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Received event network-vif-unplugged-c3f17283-3785-4d52-81a1-f8f65da2404d for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Instance destroyed successfully.
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.objects.instance [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lazy-loading 'resources' on Instance uuid 16996b6c-6d6e-4b51-88f3-0ca024e95639 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:57:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1553649845',display_name='tempest-ServersNegativeTestJSON-server-1553649845',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1553649845',id=1,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:58:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd3bb025095b443d822303c387f0deca',ramdisk_id='',reservation_id='r-owtauw04',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-868064230',owner_user_name='tempest-ServersNegativeTestJSON-868064230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T14:58:18Z,user_data=None,user_id='8f6f7c760aea49c5a2914d1dbff90077',uuid=16996b6c-6d6e-4b51-88f3-0ca024e95639,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converting VIF {"id": "c3f17283-3785-4d52-81a1-f8f65da2404d", "address": "fa:16:3e:a1:1d:28", "network": {"id": "28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1274788008-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fd3bb025095b443d822303c387f0deca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3f17283-37", "ovs_interfaceid": "c3f17283-3785-4d52-81a1-f8f65da2404d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:1d:28,bridge_name='br-int',has_traffic_filtering=True,id=c3f17283-3785-4d52-81a1-f8f65da2404d,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f17283-37') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_vif [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:1d:28,bridge_name='br-int',has_traffic_filtering=True,id=c3f17283-3785-4d52-81a1-f8f65da2404d,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f17283-37') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3f17283-37, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:06:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Instance destroyed successfully.
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lazy-loading 'resources' on Instance uuid 0110dafc-b336-45bd-aade-0eb9ba632a05 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:58:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1755851336',display_name='tempest-ServerActionsTestOtherB-server-1755851336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1755851336',id=2,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpJqshf7dgOYCNb3XdGQKDGpgxinwrIHq7RhTsMWSm+s6EZD5PqStn0mS7XZys0yosnUZjjjacxB+uA7VCgltNQhd/8n8Kmf9j/njpDibTqPOQpZxcFfHs+Tu7LtgV0vQ==',key_name='tempest-keypair-50791975',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:04:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7efec9b494b419d88e619898e61108c',ramdisk_id='',reservation_id='r-raqid4hj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-872428687',owner_user_name='tempest-ServerActionsTestOtherB-872428687-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:04:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02901b088217434eb2a8a4f914ac3e18',uuid=0110dafc-b336-45bd-aade-0eb9ba632a05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converting VIF {"id": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "address": "fa:16:3e:02:af:58", "network": {"id": "c810a1c6-88de-491f-a1a8-4942e262aefe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1966471165-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.42", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7efec9b494b419d88e619898e61108c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ce5ac2e-ae", "ovs_interfaceid": "5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_vif [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ce5ac2e-ae, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:57 user nova-compute[73254]: INFO os_vif [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:1d:28,bridge_name='br-int',has_traffic_filtering=True,id=c3f17283-3785-4d52-81a1-f8f65da2404d,network=Network(28dbd7a1-ae44-4a73-9a7a-48e2fb38fb78),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3f17283-37')
Aug 14 15:06:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Deleting instance files /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639_del
Aug 14 15:06:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Deletion of /opt/stack/data/nova/instances/16996b6c-6d6e-4b51-88f3-0ca024e95639_del complete
Aug 14 15:06:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:06:57 user nova-compute[73254]: INFO os_vif [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:af:58,bridge_name='br-int',has_traffic_filtering=True,id=5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3,network=Network(c810a1c6-88de-491f-a1a8-4942e262aefe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ce5ac2e-ae')
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IjvdWDfU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:06:57 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7873bddb-064e-492f-b447-9b5a97f4ad86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:57 user nova-compute[73254]: INFO nova.compute.manager [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b49645-f343-451e-b03a-6187bb1a8b46]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:57 user nova-compute[73254]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:06:57 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b (non-flash)
Aug 14 15:06:57 user nova-compute[73254]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:06:57 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6485763b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff043a46-377c-41dc-9a80-0adef6ae7d9f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[be61a82d-8b17-48a7-987b-e94fcb2d9d2d]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[30622639-bf59-4d72-ba29-e179c5ba73ab]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02fe05e-9e29-49db-9fb2-ef5ea6329437]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d55e2e-afcb-4379-a31d-ef6715cb3915]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[775bc35e-5dbb-4602-a5fc-dec16fde1287]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260]
Aug 14 15:06:58 user nova-compute[73254]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b, portal: 172.16.0.220,3260] successful.
Aug 14 15:06:58 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:79a4d0f2-5a42-41bd-bbbd-4e3eea10947b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d16cb87-a9e1-42fa-98d0-51a0257b9239]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] <== disconnect_volume: return (338ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:06:58 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Deleting instance files /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05_del
Aug 14 15:06:58 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Deletion of /opt/stack/data/nova/instances/0110dafc-b336-45bd-aade-0eb9ba632a05_del complete
Aug 14 15:06:58 user nova-compute[73254]: INFO nova.compute.manager [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Took 1.55 seconds to destroy the instance on the hypervisor.
Aug 14 15:06:58 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:06:58 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Took 0.72 seconds to deallocate network for instance.
Aug 14 15:06:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:06:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:59 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Deleted allocations for instance 16996b6c-6d6e-4b51-88f3-0ca024e95639
Aug 14 15:06:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-1e00bacc-1446-4af6-93d9-adce89e8ed8f req-125e8e64-9aae-4a1a-bab9-62b4a85e36bc service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1e00bacc-1446-4af6-93d9-adce89e8ed8f req-125e8e64-9aae-4a1a-bab9-62b4a85e36bc service nova] Acquiring lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1e00bacc-1446-4af6-93d9-adce89e8ed8f req-125e8e64-9aae-4a1a-bab9-62b4a85e36bc service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1e00bacc-1446-4af6-93d9-adce89e8ed8f req-125e8e64-9aae-4a1a-bab9-62b4a85e36bc service nova] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-1e00bacc-1446-4af6-93d9-adce89e8ed8f req-125e8e64-9aae-4a1a-bab9-62b4a85e36bc service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] No waiting events found dispatching network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:06:59 user nova-compute[73254]: WARNING nova.compute.manager [req-1e00bacc-1446-4af6-93d9-adce89e8ed8f req-125e8e64-9aae-4a1a-bab9-62b4a85e36bc service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received unexpected event network-vif-plugged-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 for instance with vm_state active and task_state deleting.
Aug 14 15:06:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-1e00bacc-1446-4af6-93d9-adce89e8ed8f req-125e8e64-9aae-4a1a-bab9-62b4a85e36bc service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Received event network-vif-deleted-c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2bd24a39-86f6-42e3-b364-6e089ac11f39 tempest-ServersNegativeTestJSON-868064230 tempest-ServersNegativeTestJSON-868064230-project-member] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.565s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:06:59 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Took 1.17 seconds to deallocate network for instance.
Aug 14 15:06:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-a53c0ed9-efc9-4b39-908c-40204738de12 req-69581907-72a9-4a6b-ae30-3d7d08b590dc service nova] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Received event network-vif-deleted-5ce5ac2e-ae49-42d3-b8de-e86f3b8220e3 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-e052f15c-20ee-45de-ba0f-68a9741a5bff req-f00d485c-80ac-41eb-b676-07c33bda7cd0 service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Received event network-vif-plugged-c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e052f15c-20ee-45de-ba0f-68a9741a5bff req-f00d485c-80ac-41eb-b676-07c33bda7cd0 service nova] Acquiring lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e052f15c-20ee-45de-ba0f-68a9741a5bff req-f00d485c-80ac-41eb-b676-07c33bda7cd0 service nova] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e052f15c-20ee-45de-ba0f-68a9741a5bff req-f00d485c-80ac-41eb-b676-07c33bda7cd0 service nova] Lock "16996b6c-6d6e-4b51-88f3-0ca024e95639-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-e052f15c-20ee-45de-ba0f-68a9741a5bff req-f00d485c-80ac-41eb-b676-07c33bda7cd0 service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] No waiting events found dispatching network-vif-plugged-c3f17283-3785-4d52-81a1-f8f65da2404d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:06:59 user nova-compute[73254]: WARNING nova.compute.manager [req-e052f15c-20ee-45de-ba0f-68a9741a5bff req-f00d485c-80ac-41eb-b676-07c33bda7cd0 service nova] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Received unexpected event network-vif-plugged-c3f17283-3785-4d52-81a1-f8f65da2404d for instance with vm_state deleted and task_state None.
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:06:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:00 user nova-compute[73254]: INFO nova.compute.manager [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Took 0.76 seconds to detach 1 volumes for instance.
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:00 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Deleted allocations for instance 0110dafc-b336-45bd-aade-0eb9ba632a05
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6b0e5b8c-7813-4ac4-bb27-55f14480d65a tempest-ServerActionsTestOtherB-872428687 tempest-ServerActionsTestOtherB-872428687-project-member] Lock "0110dafc-b336-45bd-aade-0eb9ba632a05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.126s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:04 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:07:04 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:07:04 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=6970MB free_disk=25.162670135498047GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:07:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 714586d7-babb-49e0-b2bd-e07cf4f47849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 456882f8-f70c-4a85-b593-c1066e732a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 01773c99-e739-4da9-8c0b-493556a46e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 923c2b29-3db6-4642-bbf0-e45c0ca6a2be actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:07:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.599s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:07:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:07:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:07:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:07 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:07:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updating instance_info_cache with network_info: [{"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-47661fd5-8d72-4021-931c-d4ce9323ff04 req-45733fc8-19c4-4338-86a8-9d566a6e9038 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-changed-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-47661fd5-8d72-4021-931c-d4ce9323ff04 req-45733fc8-19c4-4338-86a8-9d566a6e9038 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Refreshing instance network info cache due to event network-changed-b2e5b202-0340-415c-940e-e8111a13d8fe. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-47661fd5-8d72-4021-931c-d4ce9323ff04 req-45733fc8-19c4-4338-86a8-9d566a6e9038 service nova] Acquiring lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-47661fd5-8d72-4021-931c-d4ce9323ff04 req-45733fc8-19c4-4338-86a8-9d566a6e9038 service nova] Acquired lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG nova.network.neutron [req-47661fd5-8d72-4021-931c-d4ce9323ff04 req-45733fc8-19c4-4338-86a8-9d566a6e9038 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Refreshing network info cache for port b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-7ee97ebe-3984-4d36-860d-97f039404c9b req-07552640-7cbe-4d2a-a428-faeae358645a service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-changed-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-7ee97ebe-3984-4d36-860d-97f039404c9b req-07552640-7cbe-4d2a-a428-faeae358645a service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Refreshing instance network info cache due to event network-changed-e963bea9-b6dc-4cb1-be12-e5d5688d774e. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7ee97ebe-3984-4d36-860d-97f039404c9b req-07552640-7cbe-4d2a-a428-faeae358645a service nova] Acquiring lock "refresh_cache-456882f8-f70c-4a85-b593-c1066e732a9e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7ee97ebe-3984-4d36-860d-97f039404c9b req-07552640-7cbe-4d2a-a428-faeae358645a service nova] Acquired lock "refresh_cache-456882f8-f70c-4a85-b593-c1066e732a9e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG nova.network.neutron [req-7ee97ebe-3984-4d36-860d-97f039404c9b req-07552640-7cbe-4d2a-a428-faeae358645a service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Refreshing network info cache for port e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:08 user nova-compute[73254]: INFO nova.compute.manager [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Terminating instance
Aug 14 15:07:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.network.neutron [req-47661fd5-8d72-4021-931c-d4ce9323ff04 req-45733fc8-19c4-4338-86a8-9d566a6e9038 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updated VIF entry in instance network info cache for port b2e5b202-0340-415c-940e-e8111a13d8fe. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.network.neutron [req-47661fd5-8d72-4021-931c-d4ce9323ff04 req-45733fc8-19c4-4338-86a8-9d566a6e9038 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updating instance_info_cache with network_info: [{"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-47661fd5-8d72-4021-931c-d4ce9323ff04 req-45733fc8-19c4-4338-86a8-9d566a6e9038 service nova] Releasing lock "refresh_cache-4b878d88-e5f3-41b9-a399-c2da1806e1fc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:09 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Instance destroyed successfully.
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lazy-loading 'resources' on Instance uuid 4b878d88-e5f3-41b9-a399-c2da1806e1fc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T14:59:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1177744398',display_name='tempest-TestStampPattern-server-1177744398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1177744398',id=11,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaEzkBahIJ840YexSkejfPgB8Zu9IUTn4OhhFXFVyR7pO7f5lGzuSbxZ+sWUWa5xUvNWxRoCjcERWwoKcS9+q8odyZhEZxgpj4xugZIhdTa72+xL2CIyBYVuUyoIrEWBQ==',key_name='tempest-TestStampPattern-568033608',keypairs=<?>,launch_index=0,launched_at=2023-08-14T14:59:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7178e5b9b71a485ca1341c171795379e',ramdisk_id='',reservation_id='r-udam57wf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1384631137',owner_user_name='tempest-TestStampPattern-1384631137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:03:04Z,user_data=None,user_id='473f1026828f41cc810fb66cf3715daf',uuid=4b878d88-e5f3-41b9-a399-c2da1806e1fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converting VIF {"id": "b2e5b202-0340-415c-940e-e8111a13d8fe", "address": "fa:16:3e:cb:7e:c3", "network": {"id": "ba37967d-9ec3-435a-b1e2-641b5d7f7865", "bridge": "br-int", "label": "tempest-TestStampPattern-393095064-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.206", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7178e5b9b71a485ca1341c171795379e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2e5b202-03", "ovs_interfaceid": "b2e5b202-0340-415c-940e-e8111a13d8fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:7e:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2e5b202-0340-415c-940e-e8111a13d8fe,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e5b202-03') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG os_vif [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:7e:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2e5b202-0340-415c-940e-e8111a13d8fe,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e5b202-03') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2e5b202-03, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-395c08d7-3651-4d0c-a77c-1f8ee766c383 req-e89ca946-b23d-439b-896a-3d00091f7299 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-vif-unplugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-395c08d7-3651-4d0c-a77c-1f8ee766c383 req-e89ca946-b23d-439b-896a-3d00091f7299 service nova] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-395c08d7-3651-4d0c-a77c-1f8ee766c383 req-e89ca946-b23d-439b-896a-3d00091f7299 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-395c08d7-3651-4d0c-a77c-1f8ee766c383 req-e89ca946-b23d-439b-896a-3d00091f7299 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-395c08d7-3651-4d0c-a77c-1f8ee766c383 req-e89ca946-b23d-439b-896a-3d00091f7299 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] No waiting events found dispatching network-vif-unplugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-395c08d7-3651-4d0c-a77c-1f8ee766c383 req-e89ca946-b23d-439b-896a-3d00091f7299 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-vif-unplugged-b2e5b202-0340-415c-940e-e8111a13d8fe for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:07:09 user nova-compute[73254]: INFO os_vif [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:7e:c3,bridge_name='br-int',has_traffic_filtering=True,id=b2e5b202-0340-415c-940e-e8111a13d8fe,network=Network(ba37967d-9ec3-435a-b1e2-641b5d7f7865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2e5b202-03')
Aug 14 15:07:09 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Deleting instance files /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc_del
Aug 14 15:07:09 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Deletion of /opt/stack/data/nova/instances/4b878d88-e5f3-41b9-a399-c2da1806e1fc_del complete
Aug 14 15:07:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:09 user nova-compute[73254]: INFO nova.compute.manager [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 15:07:09 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.network.neutron [req-7ee97ebe-3984-4d36-860d-97f039404c9b req-07552640-7cbe-4d2a-a428-faeae358645a service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Updated VIF entry in instance network info cache for port e963bea9-b6dc-4cb1-be12-e5d5688d774e. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG nova.network.neutron [req-7ee97ebe-3984-4d36-860d-97f039404c9b req-07552640-7cbe-4d2a-a428-faeae358645a service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Updating instance_info_cache with network_info: [{"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7ee97ebe-3984-4d36-860d-97f039404c9b req-07552640-7cbe-4d2a-a428-faeae358645a service nova] Releasing lock "refresh_cache-456882f8-f70c-4a85-b593-c1066e732a9e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:10 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:10 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Took 1.18 seconds to deallocate network for instance.
Aug 14 15:07:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-a7bc7977-eac7-4238-96cb-47dd7d804712 req-60365229-dc4a-404a-b922-8213f5c1a895 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-vif-deleted-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:10 user nova-compute[73254]: INFO nova.compute.manager [req-a7bc7977-eac7-4238-96cb-47dd7d804712 req-60365229-dc4a-404a-b922-8213f5c1a895 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Neutron deleted interface b2e5b202-0340-415c-940e-e8111a13d8fe; detaching it from the instance and deleting it from the info cache
Aug 14 15:07:10 user nova-compute[73254]: DEBUG nova.network.neutron [req-a7bc7977-eac7-4238-96cb-47dd7d804712 req-60365229-dc4a-404a-b922-8213f5c1a895 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-a7bc7977-eac7-4238-96cb-47dd7d804712 req-60365229-dc4a-404a-b922-8213f5c1a895 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Detach interface failed, port_id=b2e5b202-0340-415c-940e-e8111a13d8fe, reason: Instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:07:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.314s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:11 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Deleted allocations for instance 4b878d88-e5f3-41b9-a399-c2da1806e1fc
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a451b3dd-6f80-4cf7-aaa4-f927037569e5 tempest-TestStampPattern-1384631137 tempest-TestStampPattern-1384631137-project-member] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.628s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] No waiting events found dispatching network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:11 user nova-compute[73254]: WARNING nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received unexpected event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe for instance with vm_state deleted and task_state None.
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] No waiting events found dispatching network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:11 user nova-compute[73254]: WARNING nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received unexpected event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe for instance with vm_state deleted and task_state None.
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] No waiting events found dispatching network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:11 user nova-compute[73254]: WARNING nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received unexpected event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe for instance with vm_state deleted and task_state None.
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-vif-unplugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] No waiting events found dispatching network-vif-unplugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:11 user nova-compute[73254]: WARNING nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received unexpected event network-vif-unplugged-b2e5b202-0340-415c-940e-e8111a13d8fe for instance with vm_state deleted and task_state None.
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Acquiring lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] Lock "4b878d88-e5f3-41b9-a399-c2da1806e1fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] No waiting events found dispatching network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:11 user nova-compute[73254]: WARNING nova.compute.manager [req-c72191a8-ba22-48f9-b7c4-af3b1ca18d10 req-b7992e31-31fc-454a-8591-fc1c8678ac70 service nova] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Received unexpected event network-vif-plugged-b2e5b202-0340-415c-940e-e8111a13d8fe for instance with vm_state deleted and task_state None.
Aug 14 15:07:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:12 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025617.6066358, 16996b6c-6d6e-4b51-88f3-0ca024e95639 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:07:12 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] VM Stopped (Lifecycle Event)
Aug 14 15:07:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5eb7422a-a017-42ac-b89b-17a01022aa85 None None] [instance: 16996b6c-6d6e-4b51-88f3-0ca024e95639] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:12 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025617.649767, 0110dafc-b336-45bd-aade-0eb9ba632a05 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:07:12 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] VM Stopped (Lifecycle Event)
Aug 14 15:07:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1c653715-9da5-4f38-aeaf-99e7f224541b None None] [instance: 0110dafc-b336-45bd-aade-0eb9ba632a05] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'flavor' on Instance uuid 456882f8-f70c-4a85-b593-c1066e732a9e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-110443bf-395b-42c7-a2c3-6dae90d3c34b req-036dfe3c-a167-4bf6-a580-0690efcc49f7 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received event network-changed-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-110443bf-395b-42c7-a2c3-6dae90d3c34b req-036dfe3c-a167-4bf6-a580-0690efcc49f7 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Refreshing instance network info cache due to event network-changed-f088be4d-4968-414e-aca6-6594f9bc2e06. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-110443bf-395b-42c7-a2c3-6dae90d3c34b req-036dfe3c-a167-4bf6-a580-0690efcc49f7 service nova] Acquiring lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-110443bf-395b-42c7-a2c3-6dae90d3c34b req-036dfe3c-a167-4bf6-a580-0690efcc49f7 service nova] Acquired lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-110443bf-395b-42c7-a2c3-6dae90d3c34b req-036dfe3c-a167-4bf6-a580-0690efcc49f7 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Refreshing network info cache for port f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:13 user nova-compute[73254]: INFO nova.compute.manager [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Attaching volume b79a6e32-757f-490f-88ba-79e49b0c464f to /dev/vdb
Aug 14 15:07:13 user nova-compute[73254]: DEBUG os_brick.utils [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff61de5-19fc-4f93-8f25-59c021c25215]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51fdee5-d88f-4781-8a09-4f881eb5bd8e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba34ca1-792b-4909-aeb8-0d97a54149d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd6f40-7596-4fe1-a267-34f404cb5b90]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:07:13 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:07:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8066dde-df6b-43ba-a383-82a428c86ec1]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG os_brick.utils [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:07:13 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Updating existing volume attachment record: a775908a-1595-4081-aa79-db27c43bd23a {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:07:14 user nova-compute[73254]: DEBUG nova.network.neutron [req-110443bf-395b-42c7-a2c3-6dae90d3c34b req-036dfe3c-a167-4bf6-a580-0690efcc49f7 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updated VIF entry in instance network info cache for port f088be4d-4968-414e-aca6-6594f9bc2e06. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:07:14 user nova-compute[73254]: DEBUG nova.network.neutron [req-110443bf-395b-42c7-a2c3-6dae90d3c34b req-036dfe3c-a167-4bf6-a580-0690efcc49f7 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updating instance_info_cache with network_info: [{"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-110443bf-395b-42c7-a2c3-6dae90d3c34b req-036dfe3c-a167-4bf6-a580-0690efcc49f7 service nova] Releasing lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:18 user nova-compute[73254]: INFO nova.compute.manager [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Detaching volume d486316f-a8c6-45c8-92fc-130ce931329e
Aug 14 15:07:18 user nova-compute[73254]: INFO nova.virt.block_device [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Attempting to driver detach volume d486316f-a8c6-45c8-92fc-130ce931329e from mountpoint /dev/vdb
Aug 14 15:07:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Attempting to detach device vdb from instance 714586d7-babb-49e0-b2bd-e07cf4f47849 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:07:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:07:18 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:07:18 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:07:18 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:07:18 user nova-compute[73254]:   <serial>d486316f-a8c6-45c8-92fc-130ce931329e</serial>
Aug 14 15:07:18 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:07:18 user nova-compute[73254]: </disk>
Aug 14 15:07:18 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:07:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Successfully detached device vdb from instance 714586d7-babb-49e0-b2bd-e07cf4f47849 from the persistent domain config.
Aug 14 15:07:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 714586d7-babb-49e0-b2bd-e07cf4f47849 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:07:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:07:18 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:07:18 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:07:18 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:07:18 user nova-compute[73254]:   <serial>d486316f-a8c6-45c8-92fc-130ce931329e</serial>
Aug 14 15:07:18 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:07:18 user nova-compute[73254]: </disk>
Aug 14 15:07:18 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025639.3385253, 714586d7-babb-49e0-b2bd-e07cf4f47849 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:07:19 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Successfully detached device vdb from instance 714586d7-babb-49e0-b2bd-e07cf4f47849 from the live domain config.
Aug 14 15:07:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qkzLKxcY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:07:19 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8344de60-a1ff-4060-a28f-21edd809a15d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[167f6a86-eb7e-49bf-b359-0022500ef204]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:07:19 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e (non-flash)
Aug 14 15:07:19 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6484600d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a82351-07ad-4563-a700-2953d6f611e0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3fb4bb-3a5d-44a4-ac93-3dc586926088]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f18560a-4a69-425f-961b-0fd8694cd8f3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed4dfd6-5fe9-4fbb-9ba0-c104ec25a84d]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8395a27a-664c-4a60-995c-a04708a09dff]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba950adb-5a52-4627-9633-9a401aefdfb6]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e, portal: 172.16.0.220,3260]
Aug 14 15:07:19 user nova-compute[73254]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e, portal: 172.16.0.220,3260] successful.
Aug 14 15:07:19 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d486316f-a8c6-45c8-92fc-130ce931329e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4adcbcc-13ed-4c2d-bac4-968eab414476]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] <== disconnect_volume: return (286ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:07:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:07:20 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lazy-loading 'flavor' on Instance uuid 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c073f058-b59f-45a2-b0be-7b9745cf1594 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.684s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLPJkpay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:07:22 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:07:22 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:07:22 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d7400b-188b-44a5-bbc3-c4972a0cc69c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:07:22 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2e4327-f4a2-4e69-b65f-5ddf994859ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f] added
Aug 14 15:07:22 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2326c39d-0192-4a67-96ff-9d79f36fe71e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e715121-f142-4aff-96a7-8cf73998bc3d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLPJkpay {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CLPJkpay" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[325fd339-35b4-43cb-b258-c0a4277c0bc7]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CLPJkpay'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d36820-d849-4da5-94a1-ffae88ec3730]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[01075054-a698-4d3b-bcbd-ff15b7cff808]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:07:22 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:07:22 user nova-compute[73254]:  {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:07:22 user nova-compute[73254]: WARNING os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 15:07:22 user nova-compute[73254]: 
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5065ad31-2166-476b-9844-7635ce3a08b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f, portal: 172.16.0.220,3260]
Aug 14 15:07:22 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f, portal: 172.16.0.220,3260] successful.
Aug 14 15:07:22 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f55156c-1aba-4c93-af56-db4181c8730a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcc5c38-9d88-4194-83d6-1c2e97b4da10]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:07:22 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:07:22 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72f1b49-dcb4-4f58-a0fd-2981a8e6ac81]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:07:22 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLPJkpay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:07:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:07:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26532336636356334', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:07:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532336636356334', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:07:23 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'flavor' on Instance uuid 456882f8-f70c-4a85-b593-c1066e732a9e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:07:23 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:07:23 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:07:23 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:07:23 user nova-compute[73254]:   <serial>b79a6e32-757f-490f-88ba-79e49b0c464f</serial>
Aug 14 15:07:23 user nova-compute[73254]: </disk>
Aug 14 15:07:23 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:07:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:07:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:07:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No VIF found with MAC fa:16:3e:7f:79:fc, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:07:24 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025629.3698764, 4b878d88-e5f3-41b9-a399-c2da1806e1fc => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:07:24 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] VM Stopped (Lifecycle Event)
Aug 14 15:07:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e06e7ebe-12cf-4167-a7e2-b16fd4c11e03 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.710s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ad9e0afd-ac23-49c7-80fc-0a0313db0e7c None None] [instance: 4b878d88-e5f3-41b9-a399-c2da1806e1fc] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:07:28 user nova-compute[73254]: INFO nova.compute.claims [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Claim successful on node user
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:07:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.policy [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec4cf769cd15416bbbc1b9def6d12202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f209fa7e3ab40a2b5b9dc6725195d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:07:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:07:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Creating image(s)
Aug 14 15:07:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "/opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "/opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "/opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk 1073741824" returned: 0 in 0.053s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Successfully created port: b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.174s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Cannot resize image /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG nova.objects.instance [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'migration_context' on Instance uuid 66358584-2d11-4ea0-9ab9-b64eb358c1f9 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Ensure instance console log exists: /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-4bedfaa8-e5af-483d-9ff3-77cdfa24c11b req-bc359bba-a569-4ce7-9809-0c05f4be4fbe service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-changed-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-4bedfaa8-e5af-483d-9ff3-77cdfa24c11b req-bc359bba-a569-4ce7-9809-0c05f4be4fbe service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Refreshing instance network info cache due to event network-changed-7c5be923-e482-480c-881d-36637fb4d86c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4bedfaa8-e5af-483d-9ff3-77cdfa24c11b req-bc359bba-a569-4ce7-9809-0c05f4be4fbe service nova] Acquiring lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4bedfaa8-e5af-483d-9ff3-77cdfa24c11b req-bc359bba-a569-4ce7-9809-0c05f4be4fbe service nova] Acquired lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.network.neutron [req-4bedfaa8-e5af-483d-9ff3-77cdfa24c11b req-bc359bba-a569-4ce7-9809-0c05f4be4fbe service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Refreshing network info cache for port 7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Successfully updated port: b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "refresh_cache-66358584-2d11-4ea0-9ab9-b64eb358c1f9" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquired lock "refresh_cache-66358584-2d11-4ea0-9ab9-b64eb358c1f9" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-fce7faf6-9372-4dec-9d07-df0720f32bba req-3688e00d-367a-425c-a042-1cba71a765c4 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received event network-changed-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-fce7faf6-9372-4dec-9d07-df0720f32bba req-3688e00d-367a-425c-a042-1cba71a765c4 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Refreshing instance network info cache due to event network-changed-b30152d7-64e8-4aee-967d-41308060cc8e. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fce7faf6-9372-4dec-9d07-df0720f32bba req-3688e00d-367a-425c-a042-1cba71a765c4 service nova] Acquiring lock "refresh_cache-66358584-2d11-4ea0-9ab9-b64eb358c1f9" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.network.neutron [req-4bedfaa8-e5af-483d-9ff3-77cdfa24c11b req-bc359bba-a569-4ce7-9809-0c05f4be4fbe service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updated VIF entry in instance network info cache for port 7c5be923-e482-480c-881d-36637fb4d86c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.network.neutron [req-4bedfaa8-e5af-483d-9ff3-77cdfa24c11b req-bc359bba-a569-4ce7-9809-0c05f4be4fbe service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updating instance_info_cache with network_info: [{"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.network.neutron [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Updating instance_info_cache with network_info: [{"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4bedfaa8-e5af-483d-9ff3-77cdfa24c11b req-bc359bba-a569-4ce7-9809-0c05f4be4fbe service nova] Releasing lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Releasing lock "refresh_cache-66358584-2d11-4ea0-9ab9-b64eb358c1f9" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Instance network_info: |[{"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fce7faf6-9372-4dec-9d07-df0720f32bba req-3688e00d-367a-425c-a042-1cba71a765c4 service nova] Acquired lock "refresh_cache-66358584-2d11-4ea0-9ab9-b64eb358c1f9" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.network.neutron [req-fce7faf6-9372-4dec-9d07-df0720f32bba req-3688e00d-367a-425c-a042-1cba71a765c4 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Refreshing network info cache for port b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:07:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Start _get_guest_xml network_info=[{"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:07:31 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:07:31 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-885033030',display_name='tempest-AttachVolumeNegativeTest-server-885033030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-885033030',id=26,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRJwSdc119d6q7U5ve5U1mnHeMsxUFX7IMOa6UopNbFOPXi2tKgBm2pUgyhDoIcxRLrz0vfJCiu5TcGbZGQePkva3QR0xb0m5OKh0lRWLFngNcN6N8wVZwwObrvOb6xvA==',key_name='tempest-keypair-327466599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-t404tbds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:07:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=66358584-2d11-4ea0-9ab9-b64eb358c1f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:75:0a,bridge_name='br-int',has_traffic_filtering=True,id=b30152d7-64e8-4aee-967d-41308060cc8e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb30152d7-64') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.objects.instance [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'pci_devices' on Instance uuid 66358584-2d11-4ea0-9ab9-b64eb358c1f9 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:07:31 user nova-compute[73254]:   <uuid>66358584-2d11-4ea0-9ab9-b64eb358c1f9</uuid>
Aug 14 15:07:31 user nova-compute[73254]:   <name>instance-0000001a</name>
Aug 14 15:07:31 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:07:31 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:07:31 user nova-compute[73254]:   <metadata>
Aug 14 15:07:31 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:07:31 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:07:31 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeNegativeTest-server-885033030</nova:name>
Aug 14 15:07:31 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:07:31</nova:creationTime>
Aug 14 15:07:31 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:07:31 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:07:31 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:07:31 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:07:31 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:07:31 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:07:31 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:07:31 user nova-compute[73254]:       <nova:owner>
Aug 14 15:07:31 user nova-compute[73254]:         <nova:user uuid="ec4cf769cd15416bbbc1b9def6d12202">tempest-AttachVolumeNegativeTest-476210608-project-member</nova:user>
Aug 14 15:07:31 user nova-compute[73254]:         <nova:project uuid="8f209fa7e3ab40a2b5b9dc6725195d22">tempest-AttachVolumeNegativeTest-476210608</nova:project>
Aug 14 15:07:31 user nova-compute[73254]:       </nova:owner>
Aug 14 15:07:31 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:07:31 user nova-compute[73254]:       <nova:ports>
Aug 14 15:07:31 user nova-compute[73254]:         <nova:port uuid="b30152d7-64e8-4aee-967d-41308060cc8e">
Aug 14 15:07:31 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 15:07:31 user nova-compute[73254]:         </nova:port>
Aug 14 15:07:31 user nova-compute[73254]:       </nova:ports>
Aug 14 15:07:31 user nova-compute[73254]:     </nova:instance>
Aug 14 15:07:31 user nova-compute[73254]:   </metadata>
Aug 14 15:07:31 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:07:31 user nova-compute[73254]:     <system>
Aug 14 15:07:31 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:07:31 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:07:31 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:07:31 user nova-compute[73254]:       <entry name="serial">66358584-2d11-4ea0-9ab9-b64eb358c1f9</entry>
Aug 14 15:07:31 user nova-compute[73254]:       <entry name="uuid">66358584-2d11-4ea0-9ab9-b64eb358c1f9</entry>
Aug 14 15:07:31 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:07:31 user nova-compute[73254]:     </system>
Aug 14 15:07:31 user nova-compute[73254]:   </sysinfo>
Aug 14 15:07:31 user nova-compute[73254]:   <os>
Aug 14 15:07:31 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:07:31 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:07:31 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:07:31 user nova-compute[73254]:   </os>
Aug 14 15:07:31 user nova-compute[73254]:   <features>
Aug 14 15:07:31 user nova-compute[73254]:     <acpi/>
Aug 14 15:07:31 user nova-compute[73254]:     <apic/>
Aug 14 15:07:31 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:07:31 user nova-compute[73254]:   </features>
Aug 14 15:07:31 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:07:31 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:07:31 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:07:31 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:07:31 user nova-compute[73254]:   </clock>
Aug 14 15:07:31 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:07:31 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:07:31 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:07:31 user nova-compute[73254]:   </cpu>
Aug 14 15:07:31 user nova-compute[73254]:   <devices>
Aug 14 15:07:31 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:07:31 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:07:31 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk"/>
Aug 14 15:07:31 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:07:31 user nova-compute[73254]:     </disk>
Aug 14 15:07:31 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:07:31 user nova-compute[73254]:       <mac address="fa:16:3e:1e:75:0a"/>
Aug 14 15:07:31 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:07:31 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:07:31 user nova-compute[73254]:       <target dev="tapb30152d7-64"/>
Aug 14 15:07:31 user nova-compute[73254]:     </interface>
Aug 14 15:07:31 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:07:31 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/console.log" append="off"/>
Aug 14 15:07:31 user nova-compute[73254]:     </serial>
Aug 14 15:07:31 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:07:31 user nova-compute[73254]:     <video>
Aug 14 15:07:31 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:07:31 user nova-compute[73254]:     </video>
Aug 14 15:07:31 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:07:31 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:07:31 user nova-compute[73254]:     </rng>
Aug 14 15:07:31 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:07:31 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:07:31 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:07:31 user nova-compute[73254]:     </memballoon>
Aug 14 15:07:31 user nova-compute[73254]:   </devices>
Aug 14 15:07:31 user nova-compute[73254]: </domain>
Aug 14 15:07:31 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-885033030',display_name='tempest-AttachVolumeNegativeTest-server-885033030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-885033030',id=26,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRJwSdc119d6q7U5ve5U1mnHeMsxUFX7IMOa6UopNbFOPXi2tKgBm2pUgyhDoIcxRLrz0vfJCiu5TcGbZGQePkva3QR0xb0m5OKh0lRWLFngNcN6N8wVZwwObrvOb6xvA==',key_name='tempest-keypair-327466599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-t404tbds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:07:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=66358584-2d11-4ea0-9ab9-b64eb358c1f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:75:0a,bridge_name='br-int',has_traffic_filtering=True,id=b30152d7-64e8-4aee-967d-41308060cc8e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb30152d7-64') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG os_vif [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:75:0a,bridge_name='br-int',has_traffic_filtering=True,id=b30152d7-64e8-4aee-967d-41308060cc8e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb30152d7-64') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb30152d7-64, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb30152d7-64, col_values=(('external_ids', {'iface-id': 'b30152d7-64e8-4aee-967d-41308060cc8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:75:0a', 'vm-uuid': '66358584-2d11-4ea0-9ab9-b64eb358c1f9'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:31 user nova-compute[73254]: INFO os_vif [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:75:0a,bridge_name='br-int',has_traffic_filtering=True,id=b30152d7-64e8-4aee-967d-41308060cc8e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb30152d7-64')
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No VIF found with MAC fa:16:3e:1e:75:0a, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.network.neutron [req-fce7faf6-9372-4dec-9d07-df0720f32bba req-3688e00d-367a-425c-a042-1cba71a765c4 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Updated VIF entry in instance network info cache for port b30152d7-64e8-4aee-967d-41308060cc8e. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG nova.network.neutron [req-fce7faf6-9372-4dec-9d07-df0720f32bba req-3688e00d-367a-425c-a042-1cba71a765c4 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Updating instance_info_cache with network_info: [{"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fce7faf6-9372-4dec-9d07-df0720f32bba req-3688e00d-367a-425c-a042-1cba71a765c4 service nova] Releasing lock "refresh_cache-66358584-2d11-4ea0-9ab9-b64eb358c1f9" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:32 user nova-compute[73254]: DEBUG nova.compute.manager [req-562edca2-c8c3-435a-91bc-3ce26f85ccfd req-caf147de-a85e-4a74-8520-9d535f5273bd service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received event network-vif-plugged-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-562edca2-c8c3-435a-91bc-3ce26f85ccfd req-caf147de-a85e-4a74-8520-9d535f5273bd service nova] Acquiring lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-562edca2-c8c3-435a-91bc-3ce26f85ccfd req-caf147de-a85e-4a74-8520-9d535f5273bd service nova] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-562edca2-c8c3-435a-91bc-3ce26f85ccfd req-caf147de-a85e-4a74-8520-9d535f5273bd service nova] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:32 user nova-compute[73254]: DEBUG nova.compute.manager [req-562edca2-c8c3-435a-91bc-3ce26f85ccfd req-caf147de-a85e-4a74-8520-9d535f5273bd service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] No waiting events found dispatching network-vif-plugged-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:32 user nova-compute[73254]: WARNING nova.compute.manager [req-562edca2-c8c3-435a-91bc-3ce26f85ccfd req-caf147de-a85e-4a74-8520-9d535f5273bd service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received unexpected event network-vif-plugged-b30152d7-64e8-4aee-967d-41308060cc8e for instance with vm_state building and task_state spawning.
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025654.8199475, 66358584-2d11-4ea0-9ab9-b64eb358c1f9 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:07:34 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] VM Resumed (Lifecycle Event)
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:07:34 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Instance spawned successfully.
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-bd0dadc9-0fbc-4fc2-a01d-ae31f18c2f1c req-48c47ba2-ddfb-46c0-90d0-8c86e22bf3be service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received event network-vif-plugged-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bd0dadc9-0fbc-4fc2-a01d-ae31f18c2f1c req-48c47ba2-ddfb-46c0-90d0-8c86e22bf3be service nova] Acquiring lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bd0dadc9-0fbc-4fc2-a01d-ae31f18c2f1c req-48c47ba2-ddfb-46c0-90d0-8c86e22bf3be service nova] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bd0dadc9-0fbc-4fc2-a01d-ae31f18c2f1c req-48c47ba2-ddfb-46c0-90d0-8c86e22bf3be service nova] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-bd0dadc9-0fbc-4fc2-a01d-ae31f18c2f1c req-48c47ba2-ddfb-46c0-90d0-8c86e22bf3be service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] No waiting events found dispatching network-vif-plugged-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:34 user nova-compute[73254]: WARNING nova.compute.manager [req-bd0dadc9-0fbc-4fc2-a01d-ae31f18c2f1c req-48c47ba2-ddfb-46c0-90d0-8c86e22bf3be service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received unexpected event network-vif-plugged-b30152d7-64e8-4aee-967d-41308060cc8e for instance with vm_state building and task_state spawning.
Aug 14 15:07:34 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025654.8230414, 66358584-2d11-4ea0-9ab9-b64eb358c1f9 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:07:34 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] VM Started (Lifecycle Event)
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:07:34 user nova-compute[73254]: INFO nova.compute.manager [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Took 5.96 seconds to spawn the instance on the hypervisor.
Aug 14 15:07:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:34 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:07:35 user nova-compute[73254]: INFO nova.compute.manager [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Took 6.84 seconds to build instance.
Aug 14 15:07:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-eb0bab15-53b3-466f-bf95-ee3bff4cbe9d tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.966s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01773c99-e739-4da9-8c0b-493556a46e2d" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:35 user nova-compute[73254]: INFO nova.compute.manager [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Shelving
Aug 14 15:07:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:07:35 user nova-compute[73254]: INFO nova.compute.claims [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Claim successful on node user
Aug 14 15:07:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-decf5a52-7586-49d1-8885-966927373c54 req-a2b4ef37-9e0d-43ad-a9a9-6ccd4e035545 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-vif-unplugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-decf5a52-7586-49d1-8885-966927373c54 req-a2b4ef37-9e0d-43ad-a9a9-6ccd4e035545 service nova] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-decf5a52-7586-49d1-8885-966927373c54 req-a2b4ef37-9e0d-43ad-a9a9-6ccd4e035545 service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-decf5a52-7586-49d1-8885-966927373c54 req-a2b4ef37-9e0d-43ad-a9a9-6ccd4e035545 service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-decf5a52-7586-49d1-8885-966927373c54 req-a2b4ef37-9e0d-43ad-a9a9-6ccd4e035545 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] No waiting events found dispatching network-vif-unplugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:35 user nova-compute[73254]: WARNING nova.compute.manager [req-decf5a52-7586-49d1-8885-966927373c54 req-a2b4ef37-9e0d-43ad-a9a9-6ccd4e035545 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received unexpected event network-vif-unplugged-7c5be923-e482-480c-881d-36637fb4d86c for instance with vm_state active and task_state shelving.
Aug 14 15:07:36 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:07:36 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:07:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:07:36 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Instance destroyed successfully.
Aug 14 15:07:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:07:36 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:07:36 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Beginning cold snapshot process
Aug 14 15:07:36 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:07:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:07:36 user nova-compute[73254]: INFO nova.virt.block_device [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Booting with blank volume at /dev/vda
Aug 14 15:07:36 user nova-compute[73254]: DEBUG nova.policy [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ca9fb4530574c44b1a3cfa6e1b90871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7879ba4750fa40cf9ee6bfb1daf85fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:07:36 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:07:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk /opt/stack/data/nova/instances/snapshots/tmpkocmxfsl/34ed5a3d349441b1a8293aba6ed63cac {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk /opt/stack/data/nova/instances/snapshots/tmpkocmxfsl/34ed5a3d349441b1a8293aba6ed63cac" returned: 0 in 1.159s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Snapshot extracted, beginning image upload
Aug 14 15:07:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Successfully created port: 46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:07:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-df45f806-b42b-44c5-bd2b-4be06433be72 req-1c0db26f-ce19-45d4-bfc1-71f279b6d754 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-df45f806-b42b-44c5-bd2b-4be06433be72 req-1c0db26f-ce19-45d4-bfc1-71f279b6d754 service nova] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-df45f806-b42b-44c5-bd2b-4be06433be72 req-1c0db26f-ce19-45d4-bfc1-71f279b6d754 service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-df45f806-b42b-44c5-bd2b-4be06433be72 req-1c0db26f-ce19-45d4-bfc1-71f279b6d754 service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-df45f806-b42b-44c5-bd2b-4be06433be72 req-1c0db26f-ce19-45d4-bfc1-71f279b6d754 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] No waiting events found dispatching network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:37 user nova-compute[73254]: WARNING nova.compute.manager [req-df45f806-b42b-44c5-bd2b-4be06433be72 req-1c0db26f-ce19-45d4-bfc1-71f279b6d754 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received unexpected event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c for instance with vm_state active and task_state shelving_image_uploading.
Aug 14 15:07:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Successfully updated port: 46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:07:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquired lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:07:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:07:39 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updating instance_info_cache with network_info: [{"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Releasing lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Instance network_info: |[{"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:07:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-1412013d-a74a-40c0-b372-e11240d0e7cf req-203ed3c1-dcfa-47e0-8474-6bc8b37556dc service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-changed-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-1412013d-a74a-40c0-b372-e11240d0e7cf req-203ed3c1-dcfa-47e0-8474-6bc8b37556dc service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Refreshing instance network info cache due to event network-changed-46821c5a-d60c-47a2-8b4b-500198ccc670. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:07:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1412013d-a74a-40c0-b372-e11240d0e7cf req-203ed3c1-dcfa-47e0-8474-6bc8b37556dc service nova] Acquiring lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1412013d-a74a-40c0-b372-e11240d0e7cf req-203ed3c1-dcfa-47e0-8474-6bc8b37556dc service nova] Acquired lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:39 user nova-compute[73254]: DEBUG nova.network.neutron [req-1412013d-a74a-40c0-b372-e11240d0e7cf req-203ed3c1-dcfa-47e0-8474-6bc8b37556dc service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Refreshing network info cache for port 46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:07:40 user nova-compute[73254]: INFO nova.compute.manager [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Rescuing
Aug 14 15:07:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquired lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG nova.network.neutron [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:07:40 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Snapshot image upload complete
Aug 14 15:07:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:40 user nova-compute[73254]: INFO nova.compute.manager [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Shelve offloading
Aug 14 15:07:40 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Instance destroyed successfully.
Aug 14 15:07:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquired lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG nova.network.neutron [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG nova.network.neutron [req-1412013d-a74a-40c0-b372-e11240d0e7cf req-203ed3c1-dcfa-47e0-8474-6bc8b37556dc service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updated VIF entry in instance network info cache for port 46821c5a-d60c-47a2-8b4b-500198ccc670. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG nova.network.neutron [req-1412013d-a74a-40c0-b372-e11240d0e7cf req-203ed3c1-dcfa-47e0-8474-6bc8b37556dc service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updating instance_info_cache with network_info: [{"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1412013d-a74a-40c0-b372-e11240d0e7cf req-203ed3c1-dcfa-47e0-8474-6bc8b37556dc service nova] Releasing lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG nova.network.neutron [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updating instance_info_cache with network_info: [{"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Releasing lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG nova.network.neutron [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updating instance_info_cache with network_info: [{"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG nova.objects.instance [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lazy-loading 'flavor' on Instance uuid 923c2b29-3db6-4642-bbf0-e45c0ca6a2be {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Releasing lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-9e7b7f05-5bc6-4f76-9109-fec5d78ea60b req-024f004e-7b74-4b8d-940e-d28ce0902508 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-unplugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9e7b7f05-5bc6-4f76-9109-fec5d78ea60b req-024f004e-7b74-4b8d-940e-d28ce0902508 service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9e7b7f05-5bc6-4f76-9109-fec5d78ea60b req-024f004e-7b74-4b8d-940e-d28ce0902508 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9e7b7f05-5bc6-4f76-9109-fec5d78ea60b req-024f004e-7b74-4b8d-940e-d28ce0902508 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-9e7b7f05-5bc6-4f76-9109-fec5d78ea60b req-024f004e-7b74-4b8d-940e-d28ce0902508 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-unplugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:41 user nova-compute[73254]: WARNING nova.compute.manager [req-9e7b7f05-5bc6-4f76-9109-fec5d78ea60b req-024f004e-7b74-4b8d-940e-d28ce0902508 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-unplugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state active and task_state rescuing.
Aug 14 15:07:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:41 user nova-compute[73254]: INFO nova.compute.manager [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Attaching volume 52649c18-b7fb-420e-950e-3f18203ce2c3 to /dev/vdb
Aug 14 15:07:41 user nova-compute[73254]: DEBUG os_brick.utils [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b96ddb-4949-4981-8435-a35d25a55f6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[02095d8a-d54f-4d5a-922f-3d913a85c2e7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[29305b27-dca2-4134-a6fb-1f9bc126dfeb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ddb9fd-b26c-4906-b059-d96a3bbba904]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:07:41 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0371804-283e-4c12-a1ad-1262f6502fcb]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG os_brick.utils [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Updating existing volume attachment record: 25bc4abe-b8fc-401b-98bc-796684109050 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:07:41 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Instance destroyed successfully.
Aug 14 15:07:41 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Attempting rescue
Aug 14 15:07:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73254) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Instance directory exists: not creating {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 15:07:41 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Creating image(s)
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG nova.objects.instance [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'trusted_certs' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.245s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue" returned: 0 in 0.055s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:41 user nova-compute[73254]: DEBUG nova.objects.instance [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'migration_context' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Start _get_guest_xml network_info=[{"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "vif_mac": "fa:16:3e:7d:b8:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'resources' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'numa_topology' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:42 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:07:42 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'vcpu_model' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1369978089',display_name='tempest-ServerRescueNegativeTestJSON-server-1369978089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1369978089',id=16,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-tzspyfap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:03:05Z,user_data=None,user_id='5200b421cc6c4e45b91f547888fb896a',uuid=81ebd5b0-2b15-4dcd-801f-12f89938794c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "vif_mac": "fa:16:3e:7d:b8:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "vif_mac": "fa:16:3e:7d:b8:78"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=8e9c554c-79a1-4ed6-9be6-c168ff494302,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9c554c-79') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'pci_devices' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:07:42 user nova-compute[73254]:   <uuid>81ebd5b0-2b15-4dcd-801f-12f89938794c</uuid>
Aug 14 15:07:42 user nova-compute[73254]:   <name>instance-00000010</name>
Aug 14 15:07:42 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:07:42 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:07:42 user nova-compute[73254]:   <metadata>
Aug 14 15:07:42 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:07:42 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:07:42 user nova-compute[73254]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1369978089</nova:name>
Aug 14 15:07:42 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:07:42</nova:creationTime>
Aug 14 15:07:42 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:07:42 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:07:42 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:07:42 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:07:42 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:07:42 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:07:42 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:07:42 user nova-compute[73254]:       <nova:owner>
Aug 14 15:07:42 user nova-compute[73254]:         <nova:user uuid="5200b421cc6c4e45b91f547888fb896a">tempest-ServerRescueNegativeTestJSON-324663021-project-member</nova:user>
Aug 14 15:07:42 user nova-compute[73254]:         <nova:project uuid="977830faf2af42dd8be28808611d8d16">tempest-ServerRescueNegativeTestJSON-324663021</nova:project>
Aug 14 15:07:42 user nova-compute[73254]:       </nova:owner>
Aug 14 15:07:42 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:07:42 user nova-compute[73254]:       <nova:ports>
Aug 14 15:07:42 user nova-compute[73254]:         <nova:port uuid="8e9c554c-79a1-4ed6-9be6-c168ff494302">
Aug 14 15:07:42 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 15:07:42 user nova-compute[73254]:         </nova:port>
Aug 14 15:07:42 user nova-compute[73254]:       </nova:ports>
Aug 14 15:07:42 user nova-compute[73254]:     </nova:instance>
Aug 14 15:07:42 user nova-compute[73254]:   </metadata>
Aug 14 15:07:42 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:07:42 user nova-compute[73254]:     <system>
Aug 14 15:07:42 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:07:42 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:07:42 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:07:42 user nova-compute[73254]:       <entry name="serial">81ebd5b0-2b15-4dcd-801f-12f89938794c</entry>
Aug 14 15:07:42 user nova-compute[73254]:       <entry name="uuid">81ebd5b0-2b15-4dcd-801f-12f89938794c</entry>
Aug 14 15:07:42 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:07:42 user nova-compute[73254]:     </system>
Aug 14 15:07:42 user nova-compute[73254]:   </sysinfo>
Aug 14 15:07:42 user nova-compute[73254]:   <os>
Aug 14 15:07:42 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:07:42 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:07:42 user nova-compute[73254]:   </os>
Aug 14 15:07:42 user nova-compute[73254]:   <features>
Aug 14 15:07:42 user nova-compute[73254]:     <acpi/>
Aug 14 15:07:42 user nova-compute[73254]:     <apic/>
Aug 14 15:07:42 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:07:42 user nova-compute[73254]:   </features>
Aug 14 15:07:42 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:07:42 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:07:42 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:07:42 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:07:42 user nova-compute[73254]:   </clock>
Aug 14 15:07:42 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:07:42 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:07:42 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:07:42 user nova-compute[73254]:   </cpu>
Aug 14 15:07:42 user nova-compute[73254]:   <devices>
Aug 14 15:07:42 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:07:42 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:07:42 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue"/>
Aug 14 15:07:42 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:07:42 user nova-compute[73254]:     </disk>
Aug 14 15:07:42 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:07:42 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:07:42 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk"/>
Aug 14 15:07:42 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:07:42 user nova-compute[73254]:     </disk>
Aug 14 15:07:42 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:07:42 user nova-compute[73254]:       <mac address="fa:16:3e:7d:b8:78"/>
Aug 14 15:07:42 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:07:42 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:07:42 user nova-compute[73254]:       <target dev="tap8e9c554c-79"/>
Aug 14 15:07:42 user nova-compute[73254]:     </interface>
Aug 14 15:07:42 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:07:42 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/console.log" append="off"/>
Aug 14 15:07:42 user nova-compute[73254]:     </serial>
Aug 14 15:07:42 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:07:42 user nova-compute[73254]:     <video>
Aug 14 15:07:42 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:07:42 user nova-compute[73254]:     </video>
Aug 14 15:07:42 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:07:42 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:07:42 user nova-compute[73254]:     </rng>
Aug 14 15:07:42 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:07:42 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:07:42 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:07:42 user nova-compute[73254]:     </memballoon>
Aug 14 15:07:42 user nova-compute[73254]:   </devices>
Aug 14 15:07:42 user nova-compute[73254]: </domain>
Aug 14 15:07:42 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:07:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Instance destroyed successfully.
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No VIF found with MAC fa:16:3e:7d:b8:78, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:07:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Instance destroyed successfully.
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'resources' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1981963554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1981963554',id=23,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORSMumc2z175KKxihxVqK5oLz7MtI9h0M1I9f6H36K99R6/T4QxMbFp3dDAEaOZsaRFaNu/Jq/XS2WT9vamTQxN78Bnq23SgKqo3YMAj5bIo7u2btB7GrvS9VpGXi9LZQ==',key_name='tempest-keypair-1788138174',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:05:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-u0ndwxw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member',shelved_at='2023-08-14T15:07:40.278726',shelved_host='user',shelved_image_id='8b5dad18-9ca9-4a97-8e97-a690a41d05c5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01773c99-e739-4da9-8c0b-493556a46e2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG os_vif [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c5be923-e4, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-286cb17b-7396-4ec4-92d6-29d7951b3162 req-bb5097ca-66e6-4412-8590-e8153bebfca2 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-changed-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-286cb17b-7396-4ec4-92d6-29d7951b3162 req-bb5097ca-66e6-4412-8590-e8153bebfca2 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Refreshing instance network info cache due to event network-changed-7c5be923-e482-480c-881d-36637fb4d86c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-286cb17b-7396-4ec4-92d6-29d7951b3162 req-bb5097ca-66e6-4412-8590-e8153bebfca2 service nova] Acquiring lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-286cb17b-7396-4ec4-92d6-29d7951b3162 req-bb5097ca-66e6-4412-8590-e8153bebfca2 service nova] Acquired lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.network.neutron [req-286cb17b-7396-4ec4-92d6-29d7951b3162 req-bb5097ca-66e6-4412-8590-e8153bebfca2 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Refreshing network info cache for port 7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:42 user nova-compute[73254]: INFO os_vif [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4')
Aug 14 15:07:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Deleting instance files /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d_del
Aug 14 15:07:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Deletion of /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d_del complete
Aug 14 15:07:42 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Deleted allocations for instance 01773c99-e739-4da9-8c0b-493556a46e2d
Aug 14 15:07:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'numa_topology' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG nova.network.neutron [req-286cb17b-7396-4ec4-92d6-29d7951b3162 req-bb5097ca-66e6-4412-8590-e8153bebfca2 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updated VIF entry in instance network info cache for port 7c5be923-e482-480c-881d-36637fb4d86c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG nova.network.neutron [req-286cb17b-7396-4ec4-92d6-29d7951b3162 req-bb5097ca-66e6-4412-8590-e8153bebfca2 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updating instance_info_cache with network_info: [{"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7c5be923-e4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-286cb17b-7396-4ec4-92d6-29d7951b3162 req-bb5097ca-66e6-4412-8590-e8153bebfca2 service nova] Releasing lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.379s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8f6aa6da-4e6a-4a9a-8797-a5709235f0fd tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01773c99-e739-4da9-8c0b-493556a46e2d" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.882s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-5081404d-75f8-402c-87c9-0b82507d52cc req-a31336ed-1a72-4fad-973d-794e4eded872 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5081404d-75f8-402c-87c9-0b82507d52cc req-a31336ed-1a72-4fad-973d-794e4eded872 service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5081404d-75f8-402c-87c9-0b82507d52cc req-a31336ed-1a72-4fad-973d-794e4eded872 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5081404d-75f8-402c-87c9-0b82507d52cc req-a31336ed-1a72-4fad-973d-794e4eded872 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-5081404d-75f8-402c-87c9-0b82507d52cc req-a31336ed-1a72-4fad-973d-794e4eded872 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:43 user nova-compute[73254]: WARNING nova.compute.manager [req-5081404d-75f8-402c-87c9-0b82507d52cc req-a31336ed-1a72-4fad-973d-794e4eded872 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state active and task_state rescuing.
Aug 14 15:07:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:45 user nova-compute[73254]: WARNING nova.compute.manager [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state active and task_state rescuing.
Aug 14 15:07:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:45 user nova-compute[73254]: WARNING nova.compute.manager [req-6a158345-e198-48cd-9809-2a3137a34f68 req-eea01a3f-7d4a-4200-be53-228263ceebd9 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state active and task_state rescuing.
Aug 14 15:07:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for 81ebd5b0-2b15-4dcd-801f-12f89938794c due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025665.9314508, 81ebd5b0-2b15-4dcd-801f-12f89938794c => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:07:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] VM Resumed (Lifecycle Event)
Aug 14 15:07:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-62e1887d-7850-474c-9032-3f8437a74464 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:07:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 15:07:45 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025665.9329762, 81ebd5b0-2b15-4dcd-801f-12f89938794c => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:07:45 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] VM Started (Lifecycle Event)
Aug 14 15:07:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:07:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG os_brick.utils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f3f24-e244-4345-8e68-8600681b1578]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9240017f-0878-41f0-a337-355bb8378d88]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.041s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fc2977-e685-486a-b725-9cfe36d353a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea80173-06dc-4854-a304-e2cf4ab2fc39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:07:47 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:07:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[096bd812-90b3-4123-8a50-de91af8a95bf]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG os_brick.utils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] <== get_connector_properties: return (185ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updating existing volume attachment record: a859e7f3-01df-4b62-bed8-a4aef1f54c33 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:07:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025656.1118724, 01773c99-e739-4da9-8c0b-493556a46e2d => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:07:51 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] VM Stopped (Lifecycle Event)
Aug 14 15:07:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-eeccbf28-db55-4628-9b0c-3abdddd0c672 None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBjuvIQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:07:51 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:07:51 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:07:51 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8fb975-f378-47ae-994f-5443fe7e521b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:07:51 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3813835b-58c0-4e0c-ae41-eaec540fca2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3] added
Aug 14 15:07:51 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcdee2d-89a2-4866-b6fa-904208f34a19]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d7bec6-45bd-4124-a1d0-2d035f051e34]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBjuvIQF {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yBjuvIQF" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db37a7b-b867-4f06-9f26-eed8f9e50a7d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yBjuvIQF'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d58b0e-f8a6-435b-adad-dccb5a7aecd3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[09272172-1662-40c7-8694-b4da7cfb6695]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:07:51 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:07:51 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32711d1-1df8-4491-a5cd-6a03f9d707a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3, portal: 172.16.0.220,3260]
Aug 14 15:07:51 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3, portal: 172.16.0.220,3260] successful.
Aug 14 15:07:51 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.120s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6fbdf1-3668-4d34-a52f-936817d98854]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a502a6-6749-42bd-9688-d059cb38a8fb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:07:51 user nova-compute[73254]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 (non-flash)
Aug 14 15:07:51 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:07:51 user nova-compute[73254]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 (non-flash)
Aug 14 15:07:51 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.444s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43736e8-f87e-487b-b334-83762735ade0]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:07:51 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBjuvIQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:07:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:07:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] <== connect_volume: return (1505ms) {'type': 'block', 'scsi_wwn': '23835666561346535', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:07:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835666561346535', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:07:52 user nova-compute[73254]: DEBUG nova.objects.instance [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lazy-loading 'flavor' on Instance uuid 923c2b29-3db6-4642-bbf0-e45c0ca6a2be {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:07:52 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:07:52 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:07:52 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:07:52 user nova-compute[73254]:   <serial>52649c18-b7fb-420e-950e-3f18203ce2c3</serial>
Aug 14 15:07:52 user nova-compute[73254]: </disk>
Aug 14 15:07:52 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:07:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:07:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:07:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] No VIF found with MAC fa:16:3e:87:f2:b4, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:07:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-83dcfc26-d994-4c31-9ee2-415f7df224fb tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.211s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:54 user nova-compute[73254]: INFO nova.compute.manager [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Terminating instance
Aug 14 15:07:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-26cbadcc-0d59-49df-a456-f0277ccdc27f req-99f15dc1-5f04-4979-bb5b-2562802a0b4b service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Received event network-vif-unplugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-26cbadcc-0d59-49df-a456-f0277ccdc27f req-99f15dc1-5f04-4979-bb5b-2562802a0b4b service nova] Acquiring lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-26cbadcc-0d59-49df-a456-f0277ccdc27f req-99f15dc1-5f04-4979-bb5b-2562802a0b4b service nova] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-26cbadcc-0d59-49df-a456-f0277ccdc27f req-99f15dc1-5f04-4979-bb5b-2562802a0b4b service nova] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-26cbadcc-0d59-49df-a456-f0277ccdc27f req-99f15dc1-5f04-4979-bb5b-2562802a0b4b service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] No waiting events found dispatching network-vif-unplugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-26cbadcc-0d59-49df-a456-f0277ccdc27f req-99f15dc1-5f04-4979-bb5b-2562802a0b4b service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Received event network-vif-unplugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:07:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Instance destroyed successfully.
Aug 14 15:07:55 user nova-compute[73254]: DEBUG nova.objects.instance [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lazy-loading 'resources' on Instance uuid 923c2b29-3db6-4642-bbf0-e45c0ca6a2be {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1508846477',display_name='tempest-DeleteServersTestJSON-server-1508846477',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1508846477',id=24,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:05:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07419af6d6584e63b16a633a403c2a35',ramdisk_id='',reservation_id='r-y31x0f33',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-168967147',owner_user_name='tempest-DeleteServersTestJSON-168967147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:05:55Z,user_data=None,user_id='33829eb577bb4ff1a509164d476b4f1d',uuid=923c2b29-3db6-4642-bbf0-e45c0ca6a2be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "address": "fa:16:3e:87:f2:b4", "network": {"id": "484f23e4-baa6-4c34-9913-4d79937ed2b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454098557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07419af6d6584e63b16a633a403c2a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b7c4e6-11", "ovs_interfaceid": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Converting VIF {"id": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "address": "fa:16:3e:87:f2:b4", "network": {"id": "484f23e4-baa6-4c34-9913-4d79937ed2b9", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-454098557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "07419af6d6584e63b16a633a403c2a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf4b7c4e6-11", "ovs_interfaceid": "f4b7c4e6-115b-4b49-9e46-f3092bc8272d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=f4b7c4e6-115b-4b49-9e46-f3092bc8272d,network=Network(484f23e4-baa6-4c34-9913-4d79937ed2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b7c4e6-11') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_vif [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=f4b7c4e6-115b-4b49-9e46-f3092bc8272d,network=Network(484f23e4-baa6-4c34-9913-4d79937ed2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b7c4e6-11') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf4b7c4e6-11, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:07:55 user nova-compute[73254]: INFO os_vif [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:f2:b4,bridge_name='br-int',has_traffic_filtering=True,id=f4b7c4e6-115b-4b49-9e46-f3092bc8272d,network=Network(484f23e4-baa6-4c34-9913-4d79937ed2b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf4b7c4e6-11')
Aug 14 15:07:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yBjuvIQF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:07:55 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e032907f-a514-4e0f-8cc6-84def65a0cbe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[834d4579-2d67-4da9-8bf5-04e3ade516af]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:07:55 user nova-compute[73254]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 (non-flash)
Aug 14 15:07:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:07:55 user nova-compute[73254]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 (non-flash)
Aug 14 15:07:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64868b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2538f56-ac2e-4d47-986e-d644ce07593a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5719364-dac9-449b-9328-33419a7afdb6]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d95db81-24bd-4132-8fb0-85dc5d2d87d9]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c0b72a-eb27-4313-856a-98fac5c26da9]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[581c5b4c-2475-4145-90a9-d509a6a69204]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b03905c-7e1e-43ca-b00e-e7858e71fb3c]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3, portal: 172.16.0.220,3260]
Aug 14 15:07:55 user nova-compute[73254]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3, portal: 172.16.0.220,3260] successful.
Aug 14 15:07:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52649c18-b7fb-420e-950e-3f18203ce2c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[062b2b24-589a-49ca-a346-e6f561b87153]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] <== disconnect_volume: return (353ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:07:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Deleting instance files /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be_del
Aug 14 15:07:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Deletion of /opt/stack/data/nova/instances/923c2b29-3db6-4642-bbf0-e45c0ca6a2be_del complete
Aug 14 15:07:55 user nova-compute[73254]: INFO nova.compute.manager [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 14 15:07:55 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:07:55 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:07:56 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:07:56 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Took 0.65 seconds to deallocate network for instance.
Aug 14 15:07:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-bd49c622-7b91-4590-ad0a-3f15b4f3d731 req-75e8bcb2-c8a6-41fa-a467-e8134e683a56 service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Received event network-vif-deleted-f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-23992d77-c761-44d2-8f0d-bc21d74711e8 req-eb6c7229-6844-41c4-8b20-de66d02bcc1b service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Received event network-vif-plugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:07:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-23992d77-c761-44d2-8f0d-bc21d74711e8 req-eb6c7229-6844-41c4-8b20-de66d02bcc1b service nova] Acquiring lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-23992d77-c761-44d2-8f0d-bc21d74711e8 req-eb6c7229-6844-41c4-8b20-de66d02bcc1b service nova] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-23992d77-c761-44d2-8f0d-bc21d74711e8 req-eb6c7229-6844-41c4-8b20-de66d02bcc1b service nova] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-23992d77-c761-44d2-8f0d-bc21d74711e8 req-eb6c7229-6844-41c4-8b20-de66d02bcc1b service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] No waiting events found dispatching network-vif-plugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:07:57 user nova-compute[73254]: WARNING nova.compute.manager [req-23992d77-c761-44d2-8f0d-bc21d74711e8 req-eb6c7229-6844-41c4-8b20-de66d02bcc1b service nova] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Received unexpected event network-vif-plugged-f4b7c4e6-115b-4b49-9e46-f3092bc8272d for instance with vm_state active and task_state deleting.
Aug 14 15:07:57 user nova-compute[73254]: INFO nova.compute.manager [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Took 0.83 seconds to detach 1 volumes for instance.
Aug 14 15:07:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:57 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:07:57 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:07:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:57 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Deleted allocations for instance 923c2b29-3db6-4642-bbf0-e45c0ca6a2be
Aug 14 15:07:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9dc9870b-543a-4f92-8679-8b6ca8617335 tempest-DeleteServersTestJSON-168967147 tempest-DeleteServersTestJSON-168967147-project-member] Lock "923c2b29-3db6-4642-bbf0-e45c0ca6a2be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.382s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:07:59 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Creating image(s)
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Ensure instance console log exists: /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Start _get_guest_xml network_info=[{"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a859e7f3-01df-4b62-bed8-a4aef1f54c33', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUauhwsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f', 'attached_at': '', 'detached_at': '', 'volume_id': '850bef41-dcbb-48a6-b505-c81868961600', 'serial': '850bef41-dcbb-48a6-b505-c81868961600'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:07:59 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:07:59 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUauhwsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:07:59 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:07:59 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:07:59 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b91ccaf-bf2e-471b-af55-55aaacc9ef5b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:07:59 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d5e402-e1ec-41b8-ac71-d8599dabe1a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600] added
Aug 14 15:07:59 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c062fcaf-e33b-4c06-900b-bc7bbed67130]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ddbea0-62de-40d2-92f5-95118ca67dab]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUauhwsf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUauhwsf" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2a10e2-e1ab-4e3c-99fe-3d4fbf1482e1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kUauhwsf'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bc9db7-d146-4782-9c44-4343393a37e6]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0796a227-3028-467b-9ccd-f6fbf45d7b33]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:07:59 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:07:59 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[694860f7-bb2b-4c7b-ae62-569fda36f401]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600, portal: 172.16.0.220,3260]
Aug 14 15:07:59 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600, portal: 172.16.0.220,3260] successful.
Aug 14 15:07:59 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:07:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaf7216-323a-495b-ad39-441cdebcfb73]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded58d24-270a-468d-942c-b37d0b580833]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:08:00 user nova-compute[73254]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:08:00 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:08:00 user nova-compute[73254]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:08:00 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6ac070-fc22-48b7-a980-ee2069327aee]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUauhwsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:08:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26266636164323834', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266636164323834', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1607424910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1607424910',id=27,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-e2ytg44n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:07:36Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:50:48,bridge_name='br-int',has_traffic_filtering=True,id=46821c5a-d60c-47a2-8b4b-500198ccc670,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46821c5a-d6') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'pci_devices' on Instance uuid ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:08:01 user nova-compute[73254]:   <uuid>ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f</uuid>
Aug 14 15:08:01 user nova-compute[73254]:   <name>instance-0000001b</name>
Aug 14 15:08:01 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:08:01 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:08:01 user nova-compute[73254]:   <metadata>
Aug 14 15:08:01 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:08:01 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:08:01 user nova-compute[73254]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1607424910</nova:name>
Aug 14 15:08:01 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:07:59</nova:creationTime>
Aug 14 15:08:01 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:08:01 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:08:01 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:08:01 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:08:01 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:08:01 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:08:01 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:08:01 user nova-compute[73254]:       <nova:owner>
Aug 14 15:08:01 user nova-compute[73254]:         <nova:user uuid="4ca9fb4530574c44b1a3cfa6e1b90871">tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member</nova:user>
Aug 14 15:08:01 user nova-compute[73254]:         <nova:project uuid="7879ba4750fa40cf9ee6bfb1daf85fdf">tempest-ServerBootFromVolumeStableRescueTest-1955280356</nova:project>
Aug 14 15:08:01 user nova-compute[73254]:       </nova:owner>
Aug 14 15:08:01 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:08:01 user nova-compute[73254]:       <nova:ports>
Aug 14 15:08:01 user nova-compute[73254]:         <nova:port uuid="46821c5a-d60c-47a2-8b4b-500198ccc670">
Aug 14 15:08:01 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 15:08:01 user nova-compute[73254]:         </nova:port>
Aug 14 15:08:01 user nova-compute[73254]:       </nova:ports>
Aug 14 15:08:01 user nova-compute[73254]:     </nova:instance>
Aug 14 15:08:01 user nova-compute[73254]:   </metadata>
Aug 14 15:08:01 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:08:01 user nova-compute[73254]:     <system>
Aug 14 15:08:01 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:08:01 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:08:01 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:08:01 user nova-compute[73254]:       <entry name="serial">ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f</entry>
Aug 14 15:08:01 user nova-compute[73254]:       <entry name="uuid">ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f</entry>
Aug 14 15:08:01 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:08:01 user nova-compute[73254]:     </system>
Aug 14 15:08:01 user nova-compute[73254]:   </sysinfo>
Aug 14 15:08:01 user nova-compute[73254]:   <os>
Aug 14 15:08:01 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:08:01 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:08:01 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:08:01 user nova-compute[73254]:   </os>
Aug 14 15:08:01 user nova-compute[73254]:   <features>
Aug 14 15:08:01 user nova-compute[73254]:     <acpi/>
Aug 14 15:08:01 user nova-compute[73254]:     <apic/>
Aug 14 15:08:01 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:08:01 user nova-compute[73254]:   </features>
Aug 14 15:08:01 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:08:01 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:08:01 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:08:01 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:08:01 user nova-compute[73254]:   </clock>
Aug 14 15:08:01 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:08:01 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:08:01 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:08:01 user nova-compute[73254]:   </cpu>
Aug 14 15:08:01 user nova-compute[73254]:   <devices>
Aug 14 15:08:01 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:08:01 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:08:01 user nova-compute[73254]:       <source dev="/dev/sdc"/>
Aug 14 15:08:01 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:08:01 user nova-compute[73254]:       <serial>850bef41-dcbb-48a6-b505-c81868961600</serial>
Aug 14 15:08:01 user nova-compute[73254]:     </disk>
Aug 14 15:08:01 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:08:01 user nova-compute[73254]:       <mac address="fa:16:3e:85:50:48"/>
Aug 14 15:08:01 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:08:01 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:08:01 user nova-compute[73254]:       <target dev="tap46821c5a-d6"/>
Aug 14 15:08:01 user nova-compute[73254]:     </interface>
Aug 14 15:08:01 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:08:01 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/console.log" append="off"/>
Aug 14 15:08:01 user nova-compute[73254]:     </serial>
Aug 14 15:08:01 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:08:01 user nova-compute[73254]:     <video>
Aug 14 15:08:01 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:08:01 user nova-compute[73254]:     </video>
Aug 14 15:08:01 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:08:01 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:08:01 user nova-compute[73254]:     </rng>
Aug 14 15:08:01 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:08:01 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:08:01 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:08:01 user nova-compute[73254]:     </memballoon>
Aug 14 15:08:01 user nova-compute[73254]:   </devices>
Aug 14 15:08:01 user nova-compute[73254]: </domain>
Aug 14 15:08:01 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1607424910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1607424910',id=27,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-e2ytg44n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:07:36Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:50:48,bridge_name='br-int',has_traffic_filtering=True,id=46821c5a-d60c-47a2-8b4b-500198ccc670,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46821c5a-d6') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG os_vif [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:50:48,bridge_name='br-int',has_traffic_filtering=True,id=46821c5a-d60c-47a2-8b4b-500198ccc670,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46821c5a-d6') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46821c5a-d6, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46821c5a-d6, col_values=(('external_ids', {'iface-id': '46821c5a-d60c-47a2-8b4b-500198ccc670', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:50:48', 'vm-uuid': 'ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:01 user nova-compute[73254]: INFO os_vif [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:50:48,bridge_name='br-int',has_traffic_filtering=True,id=46821c5a-d60c-47a2-8b4b-500198ccc670,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46821c5a-d6')
Aug 14 15:08:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No VIF found with MAC fa:16:3e:85:50:48, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-24af52b4-dc3d-40e9-b1cc-94c81078dfe4 req-47118199-5e5f-4574-b077-738c49f11266 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24af52b4-dc3d-40e9-b1cc-94c81078dfe4 req-47118199-5e5f-4574-b077-738c49f11266 service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24af52b4-dc3d-40e9-b1cc-94c81078dfe4 req-47118199-5e5f-4574-b077-738c49f11266 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-24af52b4-dc3d-40e9-b1cc-94c81078dfe4 req-47118199-5e5f-4574-b077-738c49f11266 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-24af52b4-dc3d-40e9-b1cc-94c81078dfe4 req-47118199-5e5f-4574-b077-738c49f11266 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:08:02 user nova-compute[73254]: WARNING nova.compute.manager [req-24af52b4-dc3d-40e9-b1cc-94c81078dfe4 req-47118199-5e5f-4574-b077-738c49f11266 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state building and task_state spawning.
Aug 14 15:08:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:08:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue --force-share --output=json" returned: 0 in 0.258s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue --force-share --output=json" returned: 0 in 0.284s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.572s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.compute.manager [req-f23295bf-49f8-4a27-828a-efd3dafebdd3 req-50253af0-754a-4262-82ab-e3ab87219835 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f23295bf-49f8-4a27-828a-efd3dafebdd3 req-50253af0-754a-4262-82ab-e3ab87219835 service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f23295bf-49f8-4a27-828a-efd3dafebdd3 req-50253af0-754a-4262-82ab-e3ab87219835 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f23295bf-49f8-4a27-828a-efd3dafebdd3 req-50253af0-754a-4262-82ab-e3ab87219835 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.compute.manager [req-f23295bf-49f8-4a27-828a-efd3dafebdd3 req-50253af0-754a-4262-82ab-e3ab87219835 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:08:05 user nova-compute[73254]: WARNING nova.compute.manager [req-f23295bf-49f8-4a27-828a-efd3dafebdd3 req-50253af0-754a-4262-82ab-e3ab87219835 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state building and task_state spawning.
Aug 14 15:08:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025685.7969902, ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:08:05 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] VM Resumed (Lifecycle Event)
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:08:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Instance spawned successfully.
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:05 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025685.8224769, ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:08:05 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] VM Started (Lifecycle Event)
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:08:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:06 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:08:06 user nova-compute[73254]: INFO nova.compute.manager [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Took 6.87 seconds to spawn the instance on the hypervisor.
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:08:06 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:08:06 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7257MB free_disk=25.250465393066406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:06 user nova-compute[73254]: INFO nova.compute.manager [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Took 31.16 seconds to build instance.
Aug 14 15:08:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d718f63a-cb40-4381-94e2-0bd3526bc1cc tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.294s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 714586d7-babb-49e0-b2bd-e07cf4f47849 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 456882f8-f70c-4a85-b593-c1066e732a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 66358584-2d11-4ea0-9ab9-b64eb358c1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:08:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:07 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:08:07 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:08:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:08:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:09 user nova-compute[73254]: INFO nova.compute.manager [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Terminating instance
Aug 14 15:08:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-96bb7173-b02e-4b8d-900c-028c7305c243 req-660f3ed4-6288-4084-8974-7196c6eb6e57 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received event network-vif-unplugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96bb7173-b02e-4b8d-900c-028c7305c243 req-660f3ed4-6288-4084-8974-7196c6eb6e57 service nova] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96bb7173-b02e-4b8d-900c-028c7305c243 req-660f3ed4-6288-4084-8974-7196c6eb6e57 service nova] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96bb7173-b02e-4b8d-900c-028c7305c243 req-660f3ed4-6288-4084-8974-7196c6eb6e57 service nova] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-96bb7173-b02e-4b8d-900c-028c7305c243 req-660f3ed4-6288-4084-8974-7196c6eb6e57 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] No waiting events found dispatching network-vif-unplugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:08:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-96bb7173-b02e-4b8d-900c-028c7305c243 req-660f3ed4-6288-4084-8974-7196c6eb6e57 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received event network-vif-unplugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Instance destroyed successfully.
Aug 14 15:08:10 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lazy-loading 'resources' on Instance uuid 714586d7-babb-49e0-b2bd-e07cf4f47849 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:04:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1943811141',display_name='tempest-TestServerVolumeAttachmentScenario-server-1943811141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1943811141',id=20,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWwuUfHA0IDJa5VwlpiNm2ko/TbdhllH10cRh7I69jvDo1RZSgQoFGYIr6DGWl5Ij46BomsDID2ZCao2NT8s27zRhjcCwmV/0Suqenu4BKbCf2jjaJbWeNwnB5pmFGZQA==',key_name='tempest-keypair-578706620',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e6a52f6944d42c083829538f3bc1016',ramdisk_id='',reservation_id='r-m1alxbs7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-642121780',owner_user_name='tempest-TestServerVolumeAttachmentScenario-642121780-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:04:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ed857ef39da84f6bb3b366468512bad8',uuid=714586d7-babb-49e0-b2bd-e07cf4f47849,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "address": "fa:16:3e:ca:3b:92", "network": {"id": "f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-902012879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e6a52f6944d42c083829538f3bc1016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff00cec3-b5", "ovs_interfaceid": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Converting VIF {"id": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "address": "fa:16:3e:ca:3b:92", "network": {"id": "f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-902012879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e6a52f6944d42c083829538f3bc1016", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff00cec3-b5", "ovs_interfaceid": "ff00cec3-b5d9-4058-ae5b-bbe4087333e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=ff00cec3-b5d9-4058-ae5b-bbe4087333e9,network=Network(f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff00cec3-b5') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG os_vif [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=ff00cec3-b5d9-4058-ae5b-bbe4087333e9,network=Network(f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff00cec3-b5') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff00cec3-b5, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:08:10 user nova-compute[73254]: INFO os_vif [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:3b:92,bridge_name='br-int',has_traffic_filtering=True,id=ff00cec3-b5d9-4058-ae5b-bbe4087333e9,network=Network(f6aa1a17-1da1-4a6a-89e1-2b62b985e2a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff00cec3-b5')
Aug 14 15:08:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Deleting instance files /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849_del
Aug 14 15:08:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Deletion of /opt/stack/data/nova/instances/714586d7-babb-49e0-b2bd-e07cf4f47849_del complete
Aug 14 15:08:10 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025675.4593623, 923c2b29-3db6-4642-bbf0-e45c0ca6a2be => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:08:10 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] VM Stopped (Lifecycle Event)
Aug 14 15:08:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1d79124e-2d43-4da2-8c65-c2a2abe28f82 None None] [instance: 923c2b29-3db6-4642-bbf0-e45c0ca6a2be] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:08:10 user nova-compute[73254]: INFO nova.compute.manager [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 14 15:08:10 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:08:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updating instance_info_cache with network_info: [{"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:08:11 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Took 1.06 seconds to deallocate network for instance.
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c9e4800b-ca54-48b4-b138-0efbc61f7812 req-54a41340-615b-41ce-9e5f-8c1e2150f307 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received event network-vif-plugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c9e4800b-ca54-48b4-b138-0efbc61f7812 req-54a41340-615b-41ce-9e5f-8c1e2150f307 service nova] Acquiring lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c9e4800b-ca54-48b4-b138-0efbc61f7812 req-54a41340-615b-41ce-9e5f-8c1e2150f307 service nova] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c9e4800b-ca54-48b4-b138-0efbc61f7812 req-54a41340-615b-41ce-9e5f-8c1e2150f307 service nova] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c9e4800b-ca54-48b4-b138-0efbc61f7812 req-54a41340-615b-41ce-9e5f-8c1e2150f307 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] No waiting events found dispatching network-vif-plugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:08:11 user nova-compute[73254]: WARNING nova.compute.manager [req-c9e4800b-ca54-48b4-b138-0efbc61f7812 req-54a41340-615b-41ce-9e5f-8c1e2150f307 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received unexpected event network-vif-plugged-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 for instance with vm_state deleted and task_state None.
Aug 14 15:08:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c9e4800b-ca54-48b4-b138-0efbc61f7812 req-54a41340-615b-41ce-9e5f-8c1e2150f307 service nova] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Received event network-vif-deleted-ff00cec3-b5d9-4058-ae5b-bbe4087333e9 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:08:12 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:08:12 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:08:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:12 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Deleted allocations for instance 714586d7-babb-49e0-b2bd-e07cf4f47849
Aug 14 15:08:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b8cc3ac3-1a31-439e-8862-80ba3c15e440 tempest-TestServerVolumeAttachmentScenario-642121780 tempest-TestServerVolumeAttachmentScenario-642121780-project-member] Lock "714586d7-babb-49e0-b2bd-e07cf4f47849" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.859s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:25 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025690.2957933, 714586d7-babb-49e0-b2bd-e07cf4f47849 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:08:25 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] VM Stopped (Lifecycle Event)
Aug 14 15:08:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-83570c9f-7c37-4d1f-9dfb-f8f667828716 None None] [instance: 714586d7-babb-49e0-b2bd-e07cf4f47849] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:08:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:08:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:08:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:08:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:08:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:35 user nova-compute[73254]: DEBUG nova.objects.instance [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'flavor' on Instance uuid 35c77333-bc2c-429b-a65f-dd87ae2bfe25 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.259s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:36 user nova-compute[73254]: INFO nova.compute.manager [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Attaching volume 9621ca7b-7842-476e-b1b4-34f1e83a484c to /dev/vdb
Aug 14 15:08:36 user nova-compute[73254]: DEBUG os_brick.utils [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ffad79-e5dd-4911-bd1a-5c8474595672]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9d1b0a-3925-4fe2-b48a-813810ec17a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d2907f-371c-4a79-bc1f-0c18f93069b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5a75a6-4654-46c3-9202-6a519dfafc38]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:08:36 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:08:36 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3ac7f5-7103-4310-ad42-e3bb2dbf44da]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG os_brick.utils [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:08:36 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updating existing volume attachment record: a154b027-1df5-49ad-b24d-81e06f714acc {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:08:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFEKZUwJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:08:46 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:08:46 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:08:46 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf331cd9-f565-4fcf-9767-a30bb4972fc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:08:46 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f3dacc-2271-42a6-b571-cc90b941771b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c] added
Aug 14 15:08:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[687e9f1a-73a4-447f-8ed6-0afc69b76786]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[436fac12-1608-4871-9a49-b2dba2e562d7]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFEKZUwJ {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SFEKZUwJ" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b69105a-c36a-41a0-bd3a-43e8218d86a0]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SFEKZUwJ'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb636ea-0d17-453f-943b-54d35dc419a5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bf976e-2ea7-433f-9f79-5c92ceb771cf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:08:46 user nova-compute[73254]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:08:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:08:46 user nova-compute[73254]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:08:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[207d9272-3b75-4651-9e00-b90d990a06f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c, portal: 172.16.0.220,3260]
Aug 14 15:08:46 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c, portal: 172.16.0.220,3260] successful.
Aug 14 15:08:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[790ff2ba-3826-4db0-a8ab-c4d8f5642e8c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3049513-16bf-4f45-94bc-03fe05e9a363]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:08:46 user nova-compute[73254]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:08:46 user nova-compute[73254]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)
Aug 14 15:08:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:08:46 user nova-compute[73254]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:08:46 user nova-compute[73254]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)
Aug 14 15:08:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:08:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d592d-884c-435a-b261-1b20e04e1804]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:08:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:08:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFEKZUwJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:08:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:08:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23638613839653264', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:08:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638613839653264', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:08:48 user nova-compute[73254]: DEBUG nova.objects.instance [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'flavor' on Instance uuid 35c77333-bc2c-429b-a65f-dd87ae2bfe25 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:08:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:08:48 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:08:48 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:08:48 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:08:48 user nova-compute[73254]:   <serial>9621ca7b-7842-476e-b1b4-34f1e83a484c</serial>
Aug 14 15:08:48 user nova-compute[73254]: </disk>
Aug 14 15:08:48 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:08:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:08:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:08:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] No VIF found with MAC fa:16:3e:43:39:12, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:08:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46663f9c-3aa8-478f-9f04-3f02966052f4 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.218s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-96f6618a-0b1c-4f72-b70c-27705c21fe35 req-820d9c9e-fbab-41f6-b85f-3b7859f8e374 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-changed-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:08:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-96f6618a-0b1c-4f72-b70c-27705c21fe35 req-820d9c9e-fbab-41f6-b85f-3b7859f8e374 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Refreshing instance network info cache due to event network-changed-2ec17370-cd59-4a47-ba00-ad12c2c4dc25. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:08:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96f6618a-0b1c-4f72-b70c-27705c21fe35 req-820d9c9e-fbab-41f6-b85f-3b7859f8e374 service nova] Acquiring lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:08:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96f6618a-0b1c-4f72-b70c-27705c21fe35 req-820d9c9e-fbab-41f6-b85f-3b7859f8e374 service nova] Acquired lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:08:52 user nova-compute[73254]: DEBUG nova.network.neutron [req-96f6618a-0b1c-4f72-b70c-27705c21fe35 req-820d9c9e-fbab-41f6-b85f-3b7859f8e374 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Refreshing network info cache for port 2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:08:53 user nova-compute[73254]: DEBUG nova.network.neutron [req-96f6618a-0b1c-4f72-b70c-27705c21fe35 req-820d9c9e-fbab-41f6-b85f-3b7859f8e374 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updated VIF entry in instance network info cache for port 2ec17370-cd59-4a47-ba00-ad12c2c4dc25. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:08:53 user nova-compute[73254]: DEBUG nova.network.neutron [req-96f6618a-0b1c-4f72-b70c-27705c21fe35 req-820d9c9e-fbab-41f6-b85f-3b7859f8e374 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updating instance_info_cache with network_info: [{"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:08:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96f6618a-0b1c-4f72-b70c-27705c21fe35 req-820d9c9e-fbab-41f6-b85f-3b7859f8e374 service nova] Releasing lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:08:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Acquiring lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:08:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:54 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:08:54 user nova-compute[73254]: INFO nova.compute.claims [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Claim successful on node user
Aug 14 15:08:54 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:08:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-3b87a80e-d344-42a2-8c96-c550d96b5221 req-a684a428-ce8d-47dd-99e5-3c9ec742f397 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-changed-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-3b87a80e-d344-42a2-8c96-c550d96b5221 req-a684a428-ce8d-47dd-99e5-3c9ec742f397 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Refreshing instance network info cache due to event network-changed-2ec17370-cd59-4a47-ba00-ad12c2c4dc25. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3b87a80e-d344-42a2-8c96-c550d96b5221 req-a684a428-ce8d-47dd-99e5-3c9ec742f397 service nova] Acquiring lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3b87a80e-d344-42a2-8c96-c550d96b5221 req-a684a428-ce8d-47dd-99e5-3c9ec742f397 service nova] Acquired lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.network.neutron [req-3b87a80e-d344-42a2-8c96-c550d96b5221 req-a684a428-ce8d-47dd-99e5-3c9ec742f397 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Refreshing network info cache for port 2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:08:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Creating image(s)
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "/opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "/opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG nova.policy [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cf23f294b5043eeaa3bd440c37b5bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774e0b54415c41ac8f99bcf51f64089f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk 1073741824" returned: 0 in 0.062s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.network.neutron [req-3b87a80e-d344-42a2-8c96-c550d96b5221 req-a684a428-ce8d-47dd-99e5-3c9ec742f397 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updated VIF entry in instance network info cache for port 2ec17370-cd59-4a47-ba00-ad12c2c4dc25. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.network.neutron [req-3b87a80e-d344-42a2-8c96-c550d96b5221 req-a684a428-ce8d-47dd-99e5-3c9ec742f397 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updating instance_info_cache with network_info: [{"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3b87a80e-d344-42a2-8c96-c550d96b5221 req-a684a428-ce8d-47dd-99e5-3c9ec742f397 service nova] Releasing lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:56 user nova-compute[73254]: INFO nova.compute.manager [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Rebooting instance
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquired lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Cannot resize image /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.objects.instance [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lazy-loading 'migration_context' on Instance uuid a4fe3ea7-bf03-486f-8a84-fb4867a6fc52 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Ensure instance console log exists: /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updating instance_info_cache with network_info: [{"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Successfully created port: d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Releasing lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:08:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Successfully updated port: d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Acquiring lock "refresh_cache-a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Acquired lock "refresh_cache-a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-746312f2-e0e3-4dc2-9e5e-c1bd07bf18bd req-ffbbd2a9-d16c-4777-bd6b-a1bcf26f0c4a service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Received event network-changed-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-746312f2-e0e3-4dc2-9e5e-c1bd07bf18bd req-ffbbd2a9-d16c-4777-bd6b-a1bcf26f0c4a service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Refreshing instance network info cache due to event network-changed-d574ca0a-56ea-4fc2-82d2-da0d3025adf0. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-746312f2-e0e3-4dc2-9e5e-c1bd07bf18bd req-ffbbd2a9-d16c-4777-bd6b-a1bcf26f0c4a service nova] Acquiring lock "refresh_cache-a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Updating instance_info_cache with network_info: [{"id": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "address": "fa:16:3e:dc:41:b8", "network": {"id": "87e72403-7fd3-4280-b101-4cad284af184", "bridge": "br-int", "label": "tempest-VolumesActionsTest-705162768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774e0b54415c41ac8f99bcf51f64089f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd574ca0a-56", "ovs_interfaceid": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Releasing lock "refresh_cache-a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Instance network_info: |[{"id": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "address": "fa:16:3e:dc:41:b8", "network": {"id": "87e72403-7fd3-4280-b101-4cad284af184", "bridge": "br-int", "label": "tempest-VolumesActionsTest-705162768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774e0b54415c41ac8f99bcf51f64089f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd574ca0a-56", "ovs_interfaceid": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-746312f2-e0e3-4dc2-9e5e-c1bd07bf18bd req-ffbbd2a9-d16c-4777-bd6b-a1bcf26f0c4a service nova] Acquired lock "refresh_cache-a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.network.neutron [req-746312f2-e0e3-4dc2-9e5e-c1bd07bf18bd req-ffbbd2a9-d16c-4777-bd6b-a1bcf26f0c4a service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Refreshing network info cache for port d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Start _get_guest_xml network_info=[{"id": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "address": "fa:16:3e:dc:41:b8", "network": {"id": "87e72403-7fd3-4280-b101-4cad284af184", "bridge": "br-int", "label": "tempest-VolumesActionsTest-705162768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774e0b54415c41ac8f99bcf51f64089f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd574ca0a-56", "ovs_interfaceid": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:08:58 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:08:58 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1141897973',display_name='tempest-VolumesActionsTest-instance-1141897973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1141897973',id=28,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='774e0b54415c41ac8f99bcf51f64089f',ramdisk_id='',reservation_id='r-920e2fsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-801740308',owner_user_name='tempest-VolumesActionsTest-801740308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:08:55Z,user_data=None,user_id='1cf23f294b5043eeaa3bd440c37b5bce',uuid=a4fe3ea7-bf03-486f-8a84-fb4867a6fc52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "address": "fa:16:3e:dc:41:b8", "network": {"id": "87e72403-7fd3-4280-b101-4cad284af184", "bridge": "br-int", "label": "tempest-VolumesActionsTest-705162768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774e0b54415c41ac8f99bcf51f64089f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd574ca0a-56", "ovs_interfaceid": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Converting VIF {"id": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "address": "fa:16:3e:dc:41:b8", "network": {"id": "87e72403-7fd3-4280-b101-4cad284af184", "bridge": "br-int", "label": "tempest-VolumesActionsTest-705162768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774e0b54415c41ac8f99bcf51f64089f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd574ca0a-56", "ovs_interfaceid": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:41:b8,bridge_name='br-int',has_traffic_filtering=True,id=d574ca0a-56ea-4fc2-82d2-da0d3025adf0,network=Network(87e72403-7fd3-4280-b101-4cad284af184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd574ca0a-56') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lazy-loading 'pci_devices' on Instance uuid a4fe3ea7-bf03-486f-8a84-fb4867a6fc52 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:08:58 user nova-compute[73254]:   <uuid>a4fe3ea7-bf03-486f-8a84-fb4867a6fc52</uuid>
Aug 14 15:08:58 user nova-compute[73254]:   <name>instance-0000001c</name>
Aug 14 15:08:58 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:08:58 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:08:58 user nova-compute[73254]:   <metadata>
Aug 14 15:08:58 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:08:58 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:08:58 user nova-compute[73254]:       <nova:name>tempest-VolumesActionsTest-instance-1141897973</nova:name>
Aug 14 15:08:58 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:08:58</nova:creationTime>
Aug 14 15:08:58 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:08:58 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:08:58 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:08:58 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:08:58 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:08:58 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:08:58 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:08:58 user nova-compute[73254]:       <nova:owner>
Aug 14 15:08:58 user nova-compute[73254]:         <nova:user uuid="1cf23f294b5043eeaa3bd440c37b5bce">tempest-VolumesActionsTest-801740308-project-member</nova:user>
Aug 14 15:08:58 user nova-compute[73254]:         <nova:project uuid="774e0b54415c41ac8f99bcf51f64089f">tempest-VolumesActionsTest-801740308</nova:project>
Aug 14 15:08:58 user nova-compute[73254]:       </nova:owner>
Aug 14 15:08:58 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:08:58 user nova-compute[73254]:       <nova:ports>
Aug 14 15:08:58 user nova-compute[73254]:         <nova:port uuid="d574ca0a-56ea-4fc2-82d2-da0d3025adf0">
Aug 14 15:08:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 15:08:58 user nova-compute[73254]:         </nova:port>
Aug 14 15:08:58 user nova-compute[73254]:       </nova:ports>
Aug 14 15:08:58 user nova-compute[73254]:     </nova:instance>
Aug 14 15:08:58 user nova-compute[73254]:   </metadata>
Aug 14 15:08:58 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:08:58 user nova-compute[73254]:     <system>
Aug 14 15:08:58 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:08:58 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:08:58 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:08:58 user nova-compute[73254]:       <entry name="serial">a4fe3ea7-bf03-486f-8a84-fb4867a6fc52</entry>
Aug 14 15:08:58 user nova-compute[73254]:       <entry name="uuid">a4fe3ea7-bf03-486f-8a84-fb4867a6fc52</entry>
Aug 14 15:08:58 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:08:58 user nova-compute[73254]:     </system>
Aug 14 15:08:58 user nova-compute[73254]:   </sysinfo>
Aug 14 15:08:58 user nova-compute[73254]:   <os>
Aug 14 15:08:58 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:08:58 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:08:58 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:08:58 user nova-compute[73254]:   </os>
Aug 14 15:08:58 user nova-compute[73254]:   <features>
Aug 14 15:08:58 user nova-compute[73254]:     <acpi/>
Aug 14 15:08:58 user nova-compute[73254]:     <apic/>
Aug 14 15:08:58 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:08:58 user nova-compute[73254]:   </features>
Aug 14 15:08:58 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:08:58 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:08:58 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:08:58 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:08:58 user nova-compute[73254]:   </clock>
Aug 14 15:08:58 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:08:58 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:08:58 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:08:58 user nova-compute[73254]:   </cpu>
Aug 14 15:08:58 user nova-compute[73254]:   <devices>
Aug 14 15:08:58 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:08:58 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:08:58 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk"/>
Aug 14 15:08:58 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:08:58 user nova-compute[73254]:     </disk>
Aug 14 15:08:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:08:58 user nova-compute[73254]:       <mac address="fa:16:3e:dc:41:b8"/>
Aug 14 15:08:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:08:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:08:58 user nova-compute[73254]:       <target dev="tapd574ca0a-56"/>
Aug 14 15:08:58 user nova-compute[73254]:     </interface>
Aug 14 15:08:58 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:08:58 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/console.log" append="off"/>
Aug 14 15:08:58 user nova-compute[73254]:     </serial>
Aug 14 15:08:58 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:08:58 user nova-compute[73254]:     <video>
Aug 14 15:08:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:08:58 user nova-compute[73254]:     </video>
Aug 14 15:08:58 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:08:58 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:08:58 user nova-compute[73254]:     </rng>
Aug 14 15:08:58 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:08:58 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:08:58 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:08:58 user nova-compute[73254]:     </memballoon>
Aug 14 15:08:58 user nova-compute[73254]:   </devices>
Aug 14 15:08:58 user nova-compute[73254]: </domain>
Aug 14 15:08:58 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1141897973',display_name='tempest-VolumesActionsTest-instance-1141897973',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1141897973',id=28,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='774e0b54415c41ac8f99bcf51f64089f',ramdisk_id='',reservation_id='r-920e2fsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-801740308',owner_user_name='tempest-VolumesActionsTest-801740308-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:08:55Z,user_data=None,user_id='1cf23f294b5043eeaa3bd440c37b5bce',uuid=a4fe3ea7-bf03-486f-8a84-fb4867a6fc52,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "address": "fa:16:3e:dc:41:b8", "network": {"id": "87e72403-7fd3-4280-b101-4cad284af184", "bridge": "br-int", "label": "tempest-VolumesActionsTest-705162768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774e0b54415c41ac8f99bcf51f64089f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd574ca0a-56", "ovs_interfaceid": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Converting VIF {"id": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "address": "fa:16:3e:dc:41:b8", "network": {"id": "87e72403-7fd3-4280-b101-4cad284af184", "bridge": "br-int", "label": "tempest-VolumesActionsTest-705162768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774e0b54415c41ac8f99bcf51f64089f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd574ca0a-56", "ovs_interfaceid": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:41:b8,bridge_name='br-int',has_traffic_filtering=True,id=d574ca0a-56ea-4fc2-82d2-da0d3025adf0,network=Network(87e72403-7fd3-4280-b101-4cad284af184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd574ca0a-56') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG os_vif [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:41:b8,bridge_name='br-int',has_traffic_filtering=True,id=d574ca0a-56ea-4fc2-82d2-da0d3025adf0,network=Network(87e72403-7fd3-4280-b101-4cad284af184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd574ca0a-56') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd574ca0a-56, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd574ca0a-56, col_values=(('external_ids', {'iface-id': 'd574ca0a-56ea-4fc2-82d2-da0d3025adf0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:41:b8', 'vm-uuid': 'a4fe3ea7-bf03-486f-8a84-fb4867a6fc52'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:58 user nova-compute[73254]: INFO os_vif [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:41:b8,bridge_name='br-int',has_traffic_filtering=True,id=d574ca0a-56ea-4fc2-82d2-da0d3025adf0,network=Network(87e72403-7fd3-4280-b101-4cad284af184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd574ca0a-56')
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:08:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] No VIF found with MAC fa:16:3e:dc:41:b8, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG nova.network.neutron [req-746312f2-e0e3-4dc2-9e5e-c1bd07bf18bd req-ffbbd2a9-d16c-4777-bd6b-a1bcf26f0c4a service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Updated VIF entry in instance network info cache for port d574ca0a-56ea-4fc2-82d2-da0d3025adf0. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG nova.network.neutron [req-746312f2-e0e3-4dc2-9e5e-c1bd07bf18bd req-ffbbd2a9-d16c-4777-bd6b-a1bcf26f0c4a service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Updating instance_info_cache with network_info: [{"id": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "address": "fa:16:3e:dc:41:b8", "network": {"id": "87e72403-7fd3-4280-b101-4cad284af184", "bridge": "br-int", "label": "tempest-VolumesActionsTest-705162768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774e0b54415c41ac8f99bcf51f64089f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd574ca0a-56", "ovs_interfaceid": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-746312f2-e0e3-4dc2-9e5e-c1bd07bf18bd req-ffbbd2a9-d16c-4777-bd6b-a1bcf26f0c4a service nova] Releasing lock "refresh_cache-a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:08:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:00 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Instance shutdown successfully.
Aug 14 15:09:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-vif-unplugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] No waiting events found dispatching network-vif-unplugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:00 user nova-compute[73254]: WARNING nova.compute.manager [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received unexpected event network-vif-unplugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 for instance with vm_state active and task_state reboot_started.
Aug 14 15:09:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] No waiting events found dispatching network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:00 user nova-compute[73254]: WARNING nova.compute.manager [req-08522173-e1e8-438a-8f99-cde35681b632 req-2b1e819c-aa81-4dd0-8b91-62509bfa7c5f service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received unexpected event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 for instance with vm_state active and task_state reboot_started.
Aug 14 15:09:00 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Received event network-vif-plugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] Acquiring lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] No waiting events found dispatching network-vif-plugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:02 user nova-compute[73254]: WARNING nova.compute.manager [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Received unexpected event network-vif-plugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 for instance with vm_state building and task_state spawning.
Aug 14 15:09:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Received event network-vif-plugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] Acquiring lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] No waiting events found dispatching network-vif-plugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:02 user nova-compute[73254]: WARNING nova.compute.manager [req-2923cfca-1577-42ed-9aeb-3f87461264f6 req-04888f73-1d3b-41cc-807b-64fef637699b service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Received unexpected event network-vif-plugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 for instance with vm_state building and task_state spawning.
Aug 14 15:09:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] No waiting events found dispatching network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:04 user nova-compute[73254]: WARNING nova.compute.manager [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received unexpected event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 for instance with vm_state active and task_state reboot_started.
Aug 14 15:09:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] No waiting events found dispatching network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:04 user nova-compute[73254]: WARNING nova.compute.manager [req-6cc3f867-4c3c-4507-8582-a8248b3da07a req-22f0602f-0a69-44b1-bd12-18308f3eff47 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received unexpected event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 for instance with vm_state active and task_state reboot_started.
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025745.1385975, a4fe3ea7-bf03-486f-8a84-fb4867a6fc52 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] VM Resumed (Lifecycle Event)
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Instance spawned successfully.
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025745.1387546, a4fe3ea7-bf03-486f-8a84-fb4867a6fc52 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] VM Started (Lifecycle Event)
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Instance running successfully.
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Instance soft rebooted successfully.
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.compute.manager [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Took 9.99 seconds to spawn the instance on the hypervisor.
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for 35c77333-bc2c-429b-a65f-dd87ae2bfe25 due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025745.2516432, 35c77333-bc2c-429b-a65f-dd87ae2bfe25 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] VM Resumed (Lifecycle Event)
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2e922703-20fb-48cc-87a0-a5e3e703328f tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.234s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025745.2615085, 35c77333-bc2c-429b-a65f-dd87ae2bfe25 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] VM Started (Lifecycle Event)
Aug 14 15:09:05 user nova-compute[73254]: INFO nova.compute.manager [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Took 11.05 seconds to build instance.
Aug 14 15:09:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17b83c63-cfd0-4f7f-bd17-1004f8dbde5c tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.223s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk --force-share --output=json" returned: 0 in 0.714s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.348s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:09:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.345s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:09:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:09:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue --force-share --output=json" returned: 0 in 0.287s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk.rescue --force-share --output=json" returned: 0 in 0.296s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:09:10 user nova-compute[73254]: INFO nova.compute.claims [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Claim successful on node user
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.348s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.850s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:09:11 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:09:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:09:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.policy [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e56bbc03d7af4dec928da4d490af7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7dd480b32e4059b4d265a6049963e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:09:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:09:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=25.261913299560547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 456882f8-f70c-4a85-b593-c1066e732a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 66358584-2d11-4ea0-9ab9-b64eb358c1f9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a4fe3ea7-bf03-486f-8a84-fb4867a6fc52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:09:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Creating image(s)
Aug 14 15:09:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "/opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "/opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "/opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.269s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.242s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.872s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk 1073741824" returned: 0 in 0.077s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.204s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Cannot resize image /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'migration_context' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Ensure instance console log exists: /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:13 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Successfully created port: 30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:09:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Successfully updated port: 30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:09:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "refresh_cache-99c570f9-25b2-4a7f-93b1-6669bc58cb97" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:09:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquired lock "refresh_cache-99c570f9-25b2-4a7f-93b1-6669bc58cb97" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:09:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:09:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-93ea3067-90b5-4f2d-a26d-dedc4187eb5f req-f3ee3464-8a20-43f8-b7c6-68da0b31f531 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-changed-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-93ea3067-90b5-4f2d-a26d-dedc4187eb5f req-f3ee3464-8a20-43f8-b7c6-68da0b31f531 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Refreshing instance network info cache due to event network-changed-30118178-a209-428b-a649-a9ebf6ef2b39. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:09:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-93ea3067-90b5-4f2d-a26d-dedc4187eb5f req-f3ee3464-8a20-43f8-b7c6-68da0b31f531 service nova] Acquiring lock "refresh_cache-99c570f9-25b2-4a7f-93b1-6669bc58cb97" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:09:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Updating instance_info_cache with network_info: [{"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Releasing lock "refresh_cache-99c570f9-25b2-4a7f-93b1-6669bc58cb97" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Instance network_info: |[{"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-93ea3067-90b5-4f2d-a26d-dedc4187eb5f req-f3ee3464-8a20-43f8-b7c6-68da0b31f531 service nova] Acquired lock "refresh_cache-99c570f9-25b2-4a7f-93b1-6669bc58cb97" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.network.neutron [req-93ea3067-90b5-4f2d-a26d-dedc4187eb5f req-f3ee3464-8a20-43f8-b7c6-68da0b31f531 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Refreshing network info cache for port 30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Start _get_guest_xml network_info=[{"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:09:15 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:09:15 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-820172951',display_name='tempest-tempest.common.compute-instance-820172951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-820172951',id=29,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxweWbtJ3snXy8ZVLWJCwG56uXS2DyyqnyaiR5jWZGSkKXxPeOvERhjeuEaq12DhRmHFNgnz7fxy604iqewq01HbXKz2UIKeLGLTXTuDmGJW7zOnPqkKRm/I8wKCjvavg==',key_name='tempest-keypair-1364011075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-fk0uij6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=99c570f9-25b2-4a7f-93b1-6669bc58cb97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'pci_devices' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:09:15 user nova-compute[73254]:   <uuid>99c570f9-25b2-4a7f-93b1-6669bc58cb97</uuid>
Aug 14 15:09:15 user nova-compute[73254]:   <name>instance-0000001d</name>
Aug 14 15:09:15 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:09:15 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:09:15 user nova-compute[73254]:   <metadata>
Aug 14 15:09:15 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:09:15 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:09:15 user nova-compute[73254]:       <nova:name>tempest-tempest.common.compute-instance-820172951</nova:name>
Aug 14 15:09:15 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:09:15</nova:creationTime>
Aug 14 15:09:15 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:09:15 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:09:15 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:09:15 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:09:15 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:09:15 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:09:15 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:09:15 user nova-compute[73254]:       <nova:owner>
Aug 14 15:09:15 user nova-compute[73254]:         <nova:user uuid="e56bbc03d7af4dec928da4d490af7b76">tempest-ServerActionsTestOtherA-1005131430-project-member</nova:user>
Aug 14 15:09:15 user nova-compute[73254]:         <nova:project uuid="8a7dd480b32e4059b4d265a6049963e4">tempest-ServerActionsTestOtherA-1005131430</nova:project>
Aug 14 15:09:15 user nova-compute[73254]:       </nova:owner>
Aug 14 15:09:15 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:09:15 user nova-compute[73254]:       <nova:ports>
Aug 14 15:09:15 user nova-compute[73254]:         <nova:port uuid="30118178-a209-428b-a649-a9ebf6ef2b39">
Aug 14 15:09:15 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 15:09:15 user nova-compute[73254]:         </nova:port>
Aug 14 15:09:15 user nova-compute[73254]:       </nova:ports>
Aug 14 15:09:15 user nova-compute[73254]:     </nova:instance>
Aug 14 15:09:15 user nova-compute[73254]:   </metadata>
Aug 14 15:09:15 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:09:15 user nova-compute[73254]:     <system>
Aug 14 15:09:15 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:09:15 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:09:15 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:09:15 user nova-compute[73254]:       <entry name="serial">99c570f9-25b2-4a7f-93b1-6669bc58cb97</entry>
Aug 14 15:09:15 user nova-compute[73254]:       <entry name="uuid">99c570f9-25b2-4a7f-93b1-6669bc58cb97</entry>
Aug 14 15:09:15 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:09:15 user nova-compute[73254]:     </system>
Aug 14 15:09:15 user nova-compute[73254]:   </sysinfo>
Aug 14 15:09:15 user nova-compute[73254]:   <os>
Aug 14 15:09:15 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:09:15 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:09:15 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:09:15 user nova-compute[73254]:   </os>
Aug 14 15:09:15 user nova-compute[73254]:   <features>
Aug 14 15:09:15 user nova-compute[73254]:     <acpi/>
Aug 14 15:09:15 user nova-compute[73254]:     <apic/>
Aug 14 15:09:15 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:09:15 user nova-compute[73254]:   </features>
Aug 14 15:09:15 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:09:15 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:09:15 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:09:15 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:09:15 user nova-compute[73254]:   </clock>
Aug 14 15:09:15 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:09:15 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:09:15 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:09:15 user nova-compute[73254]:   </cpu>
Aug 14 15:09:15 user nova-compute[73254]:   <devices>
Aug 14 15:09:15 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:09:15 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:09:15 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk"/>
Aug 14 15:09:15 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:09:15 user nova-compute[73254]:     </disk>
Aug 14 15:09:15 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:09:15 user nova-compute[73254]:       <mac address="fa:16:3e:c6:04:a3"/>
Aug 14 15:09:15 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:09:15 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:09:15 user nova-compute[73254]:       <target dev="tap30118178-a2"/>
Aug 14 15:09:15 user nova-compute[73254]:     </interface>
Aug 14 15:09:15 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:09:15 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/console.log" append="off"/>
Aug 14 15:09:15 user nova-compute[73254]:     </serial>
Aug 14 15:09:15 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:09:15 user nova-compute[73254]:     <video>
Aug 14 15:09:15 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:09:15 user nova-compute[73254]:     </video>
Aug 14 15:09:15 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:09:15 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:09:15 user nova-compute[73254]:     </rng>
Aug 14 15:09:15 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:09:15 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:09:15 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:09:15 user nova-compute[73254]:     </memballoon>
Aug 14 15:09:15 user nova-compute[73254]:   </devices>
Aug 14 15:09:15 user nova-compute[73254]: </domain>
Aug 14 15:09:15 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-820172951',display_name='tempest-tempest.common.compute-instance-820172951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-820172951',id=29,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxweWbtJ3snXy8ZVLWJCwG56uXS2DyyqnyaiR5jWZGSkKXxPeOvERhjeuEaq12DhRmHFNgnz7fxy604iqewq01HbXKz2UIKeLGLTXTuDmGJW7zOnPqkKRm/I8wKCjvavg==',key_name='tempest-keypair-1364011075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-fk0uij6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=99c570f9-25b2-4a7f-93b1-6669bc58cb97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG os_vif [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30118178-a2, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30118178-a2, col_values=(('external_ids', {'iface-id': '30118178-a209-428b-a649-a9ebf6ef2b39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:04:a3', 'vm-uuid': '99c570f9-25b2-4a7f-93b1-6669bc58cb97'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:15 user nova-compute[73254]: INFO os_vif [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2')
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No VIF found with MAC fa:16:3e:c6:04:a3, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:09:15 user nova-compute[73254]: INFO nova.compute.claims [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Claim successful on node user
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.network.neutron [req-93ea3067-90b5-4f2d-a26d-dedc4187eb5f req-f3ee3464-8a20-43f8-b7c6-68da0b31f531 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Updated VIF entry in instance network info cache for port 30118178-a209-428b-a649-a9ebf6ef2b39. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG nova.network.neutron [req-93ea3067-90b5-4f2d-a26d-dedc4187eb5f req-f3ee3464-8a20-43f8-b7c6-68da0b31f531 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Updating instance_info_cache with network_info: [{"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-93ea3067-90b5-4f2d-a26d-dedc4187eb5f req-f3ee3464-8a20-43f8-b7c6-68da0b31f531 service nova] Releasing lock "refresh_cache-99c570f9-25b2-4a7f-93b1-6669bc58cb97" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:09:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.policy [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c222956873d2461ba0f1400b64753f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70a43ea1458433fa79e23879bd176d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:09:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Creating image(s)
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.007s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.272s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk 1073741824" returned: 0 in 0.085s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Updating instance_info_cache with network_info: [{"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Successfully created port: 0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.252s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-0f4c2c9b-3d58-4fbb-b3ec-774c2557ebff req-6bcc6639-2dc5-43e6-b67c-4254dd01311b service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0f4c2c9b-3d58-4fbb-b3ec-774c2557ebff req-6bcc6639-2dc5-43e6-b67c-4254dd01311b service nova] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0f4c2c9b-3d58-4fbb-b3ec-774c2557ebff req-6bcc6639-2dc5-43e6-b67c-4254dd01311b service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0f4c2c9b-3d58-4fbb-b3ec-774c2557ebff req-6bcc6639-2dc5-43e6-b67c-4254dd01311b service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-0f4c2c9b-3d58-4fbb-b3ec-774c2557ebff req-6bcc6639-2dc5-43e6-b67c-4254dd01311b service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] No waiting events found dispatching network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:17 user nova-compute[73254]: WARNING nova.compute.manager [req-0f4c2c9b-3d58-4fbb-b3ec-774c2557ebff req-6bcc6639-2dc5-43e6-b67c-4254dd01311b service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received unexpected event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 for instance with vm_state building and task_state spawning.
Aug 14 15:09:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Cannot resize image /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'migration_context' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Ensure instance console log exists: /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Successfully updated port: 0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:09:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:09:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquired lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:09:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:09:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-4db236c8-8823-45f7-8d65-179b29772097 req-67d11cbc-9340-4764-bf25-aa607e95e5e6 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-changed-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-4db236c8-8823-45f7-8d65-179b29772097 req-67d11cbc-9340-4764-bf25-aa607e95e5e6 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Refreshing instance network info cache due to event network-changed-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:09:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4db236c8-8823-45f7-8d65-179b29772097 req-67d11cbc-9340-4764-bf25-aa607e95e5e6 service nova] Acquiring lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:09:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025759.3943148, 99c570f9-25b2-4a7f-93b1-6669bc58cb97 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] VM Resumed (Lifecycle Event)
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:19 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Instance spawned successfully.
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025759.396481, 99c570f9-25b2-4a7f-93b1-6669bc58cb97 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] VM Started (Lifecycle Event)
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-8d2f1b96-8b69-4bd6-9b0e-d64621f4128b req-7e17da1d-d462-44a4-95c0-79d9e6528711 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8d2f1b96-8b69-4bd6-9b0e-d64621f4128b req-7e17da1d-d462-44a4-95c0-79d9e6528711 service nova] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8d2f1b96-8b69-4bd6-9b0e-d64621f4128b req-7e17da1d-d462-44a4-95c0-79d9e6528711 service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8d2f1b96-8b69-4bd6-9b0e-d64621f4128b req-7e17da1d-d462-44a4-95c0-79d9e6528711 service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-8d2f1b96-8b69-4bd6-9b0e-d64621f4128b req-7e17da1d-d462-44a4-95c0-79d9e6528711 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] No waiting events found dispatching network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:19 user nova-compute[73254]: WARNING nova.compute.manager [req-8d2f1b96-8b69-4bd6-9b0e-d64621f4128b req-7e17da1d-d462-44a4-95c0-79d9e6528711 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received unexpected event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 for instance with vm_state building and task_state spawning.
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Took 6.95 seconds to spawn the instance on the hypervisor.
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updating instance_info_cache with network_info: [{"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Releasing lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Instance network_info: |[{"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4db236c8-8823-45f7-8d65-179b29772097 req-67d11cbc-9340-4764-bf25-aa607e95e5e6 service nova] Acquired lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.network.neutron [req-4db236c8-8823-45f7-8d65-179b29772097 req-67d11cbc-9340-4764-bf25-aa607e95e5e6 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Refreshing network info cache for port 0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Start _get_guest_xml network_info=[{"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:09:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Took 9.43 seconds to build instance.
Aug 14 15:09:19 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:09:19 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:09:19 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-172163985',display_name='tempest-ServerStableDeviceRescueTest-server-172163985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-172163985',id=30,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxSDJACbjhIkGWnGpSWRk519GgcSYyay2GRwh62lCPZ3y3CSlhufil/PY6EpBEH9m5Z7/xfEiNhrRF/EDZlo4ceaSq1ERJmh6bf4Gd00J2LXPtEt/9Dp39tyHYftpECEA==',key_name='tempest-keypair-868150660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70a43ea1458433fa79e23879bd176d4',ramdisk_id='',reservation_id='r-53sa0a7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-400577676',owner_user_name='tempest-ServerStableDeviceRescueTest-400577676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:09:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c222956873d2461ba0f1400b64753f51',uuid=a651971c-b3b5-490b-b09e-6f93be59c663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Converting VIF {"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:76,bridge_name='br-int',has_traffic_filtering=True,id=0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4,network=Network(ae4f3eb0-0aec-4a48-934e-ac1cda89e0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5b3b2e-f9') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'pci_devices' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6073606-464a-4769-aee5-20d639fe5088 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.718s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:09:20 user nova-compute[73254]:   <uuid>a651971c-b3b5-490b-b09e-6f93be59c663</uuid>
Aug 14 15:09:20 user nova-compute[73254]:   <name>instance-0000001e</name>
Aug 14 15:09:20 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:09:20 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:09:20 user nova-compute[73254]:   <metadata>
Aug 14 15:09:20 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:09:20 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:09:20 user nova-compute[73254]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-172163985</nova:name>
Aug 14 15:09:20 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:09:19</nova:creationTime>
Aug 14 15:09:20 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:09:20 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:09:20 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:09:20 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:09:20 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:09:20 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:09:20 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:09:20 user nova-compute[73254]:       <nova:owner>
Aug 14 15:09:20 user nova-compute[73254]:         <nova:user uuid="c222956873d2461ba0f1400b64753f51">tempest-ServerStableDeviceRescueTest-400577676-project-member</nova:user>
Aug 14 15:09:20 user nova-compute[73254]:         <nova:project uuid="a70a43ea1458433fa79e23879bd176d4">tempest-ServerStableDeviceRescueTest-400577676</nova:project>
Aug 14 15:09:20 user nova-compute[73254]:       </nova:owner>
Aug 14 15:09:20 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:09:20 user nova-compute[73254]:       <nova:ports>
Aug 14 15:09:20 user nova-compute[73254]:         <nova:port uuid="0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4">
Aug 14 15:09:20 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 15:09:20 user nova-compute[73254]:         </nova:port>
Aug 14 15:09:20 user nova-compute[73254]:       </nova:ports>
Aug 14 15:09:20 user nova-compute[73254]:     </nova:instance>
Aug 14 15:09:20 user nova-compute[73254]:   </metadata>
Aug 14 15:09:20 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:09:20 user nova-compute[73254]:     <system>
Aug 14 15:09:20 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:09:20 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:09:20 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:09:20 user nova-compute[73254]:       <entry name="serial">a651971c-b3b5-490b-b09e-6f93be59c663</entry>
Aug 14 15:09:20 user nova-compute[73254]:       <entry name="uuid">a651971c-b3b5-490b-b09e-6f93be59c663</entry>
Aug 14 15:09:20 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:09:20 user nova-compute[73254]:     </system>
Aug 14 15:09:20 user nova-compute[73254]:   </sysinfo>
Aug 14 15:09:20 user nova-compute[73254]:   <os>
Aug 14 15:09:20 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:09:20 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:09:20 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:09:20 user nova-compute[73254]:   </os>
Aug 14 15:09:20 user nova-compute[73254]:   <features>
Aug 14 15:09:20 user nova-compute[73254]:     <acpi/>
Aug 14 15:09:20 user nova-compute[73254]:     <apic/>
Aug 14 15:09:20 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:09:20 user nova-compute[73254]:   </features>
Aug 14 15:09:20 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:09:20 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:09:20 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:09:20 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:09:20 user nova-compute[73254]:   </clock>
Aug 14 15:09:20 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:09:20 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:09:20 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:09:20 user nova-compute[73254]:   </cpu>
Aug 14 15:09:20 user nova-compute[73254]:   <devices>
Aug 14 15:09:20 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:09:20 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:09:20 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk"/>
Aug 14 15:09:20 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:09:20 user nova-compute[73254]:     </disk>
Aug 14 15:09:20 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:09:20 user nova-compute[73254]:       <mac address="fa:16:3e:df:e2:76"/>
Aug 14 15:09:20 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:09:20 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:09:20 user nova-compute[73254]:       <target dev="tap0c5b3b2e-f9"/>
Aug 14 15:09:20 user nova-compute[73254]:     </interface>
Aug 14 15:09:20 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:09:20 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/console.log" append="off"/>
Aug 14 15:09:20 user nova-compute[73254]:     </serial>
Aug 14 15:09:20 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:09:20 user nova-compute[73254]:     <video>
Aug 14 15:09:20 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:09:20 user nova-compute[73254]:     </video>
Aug 14 15:09:20 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:09:20 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:09:20 user nova-compute[73254]:     </rng>
Aug 14 15:09:20 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:09:20 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:09:20 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:09:20 user nova-compute[73254]:     </memballoon>
Aug 14 15:09:20 user nova-compute[73254]:   </devices>
Aug 14 15:09:20 user nova-compute[73254]: </domain>
Aug 14 15:09:20 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-172163985',display_name='tempest-ServerStableDeviceRescueTest-server-172163985',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-172163985',id=30,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxSDJACbjhIkGWnGpSWRk519GgcSYyay2GRwh62lCPZ3y3CSlhufil/PY6EpBEH9m5Z7/xfEiNhrRF/EDZlo4ceaSq1ERJmh6bf4Gd00J2LXPtEt/9Dp39tyHYftpECEA==',key_name='tempest-keypair-868150660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70a43ea1458433fa79e23879bd176d4',ramdisk_id='',reservation_id='r-53sa0a7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-400577676',owner_user_name='tempest-ServerStableDeviceRescueTest-400577676-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:09:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c222956873d2461ba0f1400b64753f51',uuid=a651971c-b3b5-490b-b09e-6f93be59c663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Converting VIF {"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:76,bridge_name='br-int',has_traffic_filtering=True,id=0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4,network=Network(ae4f3eb0-0aec-4a48-934e-ac1cda89e0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5b3b2e-f9') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG os_vif [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:76,bridge_name='br-int',has_traffic_filtering=True,id=0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4,network=Network(ae4f3eb0-0aec-4a48-934e-ac1cda89e0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5b3b2e-f9') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c5b3b2e-f9, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0c5b3b2e-f9, col_values=(('external_ids', {'iface-id': '0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:e2:76', 'vm-uuid': 'a651971c-b3b5-490b-b09e-6f93be59c663'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:20 user nova-compute[73254]: INFO os_vif [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:e2:76,bridge_name='br-int',has_traffic_filtering=True,id=0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4,network=Network(ae4f3eb0-0aec-4a48-934e-ac1cda89e0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5b3b2e-f9')
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] No VIF found with MAC fa:16:3e:df:e2:76, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:20 user nova-compute[73254]: INFO nova.compute.manager [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Terminating instance
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.network.neutron [req-4db236c8-8823-45f7-8d65-179b29772097 req-67d11cbc-9340-4764-bf25-aa607e95e5e6 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updated VIF entry in instance network info cache for port 0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.network.neutron [req-4db236c8-8823-45f7-8d65-179b29772097 req-67d11cbc-9340-4764-bf25-aa607e95e5e6 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updating instance_info_cache with network_info: [{"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-c6941054-0626-47e9-bbc8-07fb97945ec2 req-4f95e908-e4b9-4166-ba73-3c6f60b93478 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received event network-vif-unplugged-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c6941054-0626-47e9-bbc8-07fb97945ec2 req-4f95e908-e4b9-4166-ba73-3c6f60b93478 service nova] Acquiring lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c6941054-0626-47e9-bbc8-07fb97945ec2 req-4f95e908-e4b9-4166-ba73-3c6f60b93478 service nova] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c6941054-0626-47e9-bbc8-07fb97945ec2 req-4f95e908-e4b9-4166-ba73-3c6f60b93478 service nova] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-c6941054-0626-47e9-bbc8-07fb97945ec2 req-4f95e908-e4b9-4166-ba73-3c6f60b93478 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] No waiting events found dispatching network-vif-unplugged-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-c6941054-0626-47e9-bbc8-07fb97945ec2 req-4f95e908-e4b9-4166-ba73-3c6f60b93478 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received event network-vif-unplugged-b30152d7-64e8-4aee-967d-41308060cc8e for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4db236c8-8823-45f7-8d65-179b29772097 req-67d11cbc-9340-4764-bf25-aa607e95e5e6 service nova] Releasing lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:21 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Instance destroyed successfully.
Aug 14 15:09:21 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'resources' on Instance uuid 66358584-2d11-4ea0-9ab9-b64eb358c1f9 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:07:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-885033030',display_name='tempest-AttachVolumeNegativeTest-server-885033030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-885033030',id=26,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJRJwSdc119d6q7U5ve5U1mnHeMsxUFX7IMOa6UopNbFOPXi2tKgBm2pUgyhDoIcxRLrz0vfJCiu5TcGbZGQePkva3QR0xb0m5OKh0lRWLFngNcN6N8wVZwwObrvOb6xvA==',key_name='tempest-keypair-327466599',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:07:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-t404tbds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=66358584-2d11-4ea0-9ab9-b64eb358c1f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:75:0a,bridge_name='br-int',has_traffic_filtering=True,id=b30152d7-64e8-4aee-967d-41308060cc8e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb30152d7-64') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG os_vif [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:75:0a,bridge_name='br-int',has_traffic_filtering=True,id=b30152d7-64e8-4aee-967d-41308060cc8e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb30152d7-64') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb30152d7-64, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:21 user nova-compute[73254]: INFO os_vif [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:75:0a,bridge_name='br-int',has_traffic_filtering=True,id=b30152d7-64e8-4aee-967d-41308060cc8e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb30152d7-64')
Aug 14 15:09:21 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Deleting instance files /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9_del
Aug 14 15:09:21 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Deletion of /opt/stack/data/nova/instances/66358584-2d11-4ea0-9ab9-b64eb358c1f9_del complete
Aug 14 15:09:21 user nova-compute[73254]: INFO nova.compute.manager [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 14 15:09:21 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG nova.compute.manager [req-39946210-d4ee-4392-996d-a316a172a804 req-b2c24f20-2a19-427c-b88f-2372795f658e service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received event network-changed-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG nova.compute.manager [req-39946210-d4ee-4392-996d-a316a172a804 req-b2c24f20-2a19-427c-b88f-2372795f658e service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Refreshing instance network info cache due to event network-changed-b30152d7-64e8-4aee-967d-41308060cc8e. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-39946210-d4ee-4392-996d-a316a172a804 req-b2c24f20-2a19-427c-b88f-2372795f658e service nova] Acquiring lock "refresh_cache-66358584-2d11-4ea0-9ab9-b64eb358c1f9" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-39946210-d4ee-4392-996d-a316a172a804 req-b2c24f20-2a19-427c-b88f-2372795f658e service nova] Acquired lock "refresh_cache-66358584-2d11-4ea0-9ab9-b64eb358c1f9" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:09:21 user nova-compute[73254]: DEBUG nova.network.neutron [req-39946210-d4ee-4392-996d-a316a172a804 req-b2c24f20-2a19-427c-b88f-2372795f658e service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Refreshing network info cache for port b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-1c8621ac-20a6-4ba9-a3d4-0a38d08314b6 req-1e2946b9-e228-410b-913e-7c589f0f8c88 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received event network-vif-deleted-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:22 user nova-compute[73254]: INFO nova.compute.manager [req-1c8621ac-20a6-4ba9-a3d4-0a38d08314b6 req-1e2946b9-e228-410b-913e-7c589f0f8c88 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Neutron deleted interface b30152d7-64e8-4aee-967d-41308060cc8e; detaching it from the instance and deleting it from the info cache
Aug 14 15:09:22 user nova-compute[73254]: DEBUG nova.network.neutron [req-1c8621ac-20a6-4ba9-a3d4-0a38d08314b6 req-1e2946b9-e228-410b-913e-7c589f0f8c88 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:22 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Took 1.22 seconds to deallocate network for instance.
Aug 14 15:09:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-1c8621ac-20a6-4ba9-a3d4-0a38d08314b6 req-1e2946b9-e228-410b-913e-7c589f0f8c88 service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Detach interface failed, port_id=b30152d7-64e8-4aee-967d-41308060cc8e, reason: Instance 66358584-2d11-4ea0-9ab9-b64eb358c1f9 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-bf2f89d9-81d6-4bab-98a6-54497f7ed1cb req-547d42b1-7a9c-4402-a3a6-1635cbef66ab service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received event network-vif-plugged-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bf2f89d9-81d6-4bab-98a6-54497f7ed1cb req-547d42b1-7a9c-4402-a3a6-1635cbef66ab service nova] Acquiring lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bf2f89d9-81d6-4bab-98a6-54497f7ed1cb req-547d42b1-7a9c-4402-a3a6-1635cbef66ab service nova] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bf2f89d9-81d6-4bab-98a6-54497f7ed1cb req-547d42b1-7a9c-4402-a3a6-1635cbef66ab service nova] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-bf2f89d9-81d6-4bab-98a6-54497f7ed1cb req-547d42b1-7a9c-4402-a3a6-1635cbef66ab service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] No waiting events found dispatching network-vif-plugged-b30152d7-64e8-4aee-967d-41308060cc8e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:22 user nova-compute[73254]: WARNING nova.compute.manager [req-bf2f89d9-81d6-4bab-98a6-54497f7ed1cb req-547d42b1-7a9c-4402-a3a6-1635cbef66ab service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Received unexpected event network-vif-plugged-b30152d7-64e8-4aee-967d-41308060cc8e for instance with vm_state active and task_state deleting.
Aug 14 15:09:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:23 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:09:23 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:09:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.562s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:23 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Deleted allocations for instance 66358584-2d11-4ea0-9ab9-b64eb358c1f9
Aug 14 15:09:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c367e62b-533c-4b6d-8558-831a892e0974 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "66358584-2d11-4ea0-9ab9-b64eb358c1f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.248s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:23 user nova-compute[73254]: DEBUG nova.network.neutron [req-39946210-d4ee-4392-996d-a316a172a804 req-b2c24f20-2a19-427c-b88f-2372795f658e service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Updated VIF entry in instance network info cache for port b30152d7-64e8-4aee-967d-41308060cc8e. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:09:23 user nova-compute[73254]: DEBUG nova.network.neutron [req-39946210-d4ee-4392-996d-a316a172a804 req-b2c24f20-2a19-427c-b88f-2372795f658e service nova] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Updating instance_info_cache with network_info: [{"id": "b30152d7-64e8-4aee-967d-41308060cc8e", "address": "fa:16:3e:1e:75:0a", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb30152d7-64", "ovs_interfaceid": "b30152d7-64e8-4aee-967d-41308060cc8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-39946210-d4ee-4392-996d-a316a172a804 req-b2c24f20-2a19-427c-b88f-2372795f658e service nova] Releasing lock "refresh_cache-66358584-2d11-4ea0-9ab9-b64eb358c1f9" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:24 user nova-compute[73254]: WARNING nova.compute.manager [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state building and task_state spawning.
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:24 user nova-compute[73254]: WARNING nova.compute.manager [req-d0eb8b84-6251-40e4-831a-215db5889a51 req-cd253f75-3881-49e2-b03d-85cb67266e23 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state building and task_state spawning.
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025764.4722993, a651971c-b3b5-490b-b09e-6f93be59c663 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:24 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] VM Resumed (Lifecycle Event)
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:09:24 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Instance spawned successfully.
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:09:24 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025764.4734967, a651971c-b3b5-490b-b09e-6f93be59c663 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:24 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] VM Started (Lifecycle Event)
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:24 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:09:24 user nova-compute[73254]: INFO nova.compute.manager [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Took 8.09 seconds to spawn the instance on the hypervisor.
Aug 14 15:09:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:24 user nova-compute[73254]: INFO nova.compute.manager [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Took 9.17 seconds to build instance.
Aug 14 15:09:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c3d3b8be-6aaa-4c76-b417-b81a239b4e35 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.347s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:26 user nova-compute[73254]: INFO nova.compute.manager [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Rescuing
Aug 14 15:09:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:09:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquired lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:09:26 user nova-compute[73254]: DEBUG nova.network.neutron [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:09:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG nova.network.neutron [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updating instance_info_cache with network_info: [{"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Releasing lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-7bf789f8-3675-489e-b9b2-9cc639bde4b0 req-54181d5c-4f82-4c7c-bab1-6358d56ce05f service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-unplugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7bf789f8-3675-489e-b9b2-9cc639bde4b0 req-54181d5c-4f82-4c7c-bab1-6358d56ce05f service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7bf789f8-3675-489e-b9b2-9cc639bde4b0 req-54181d5c-4f82-4c7c-bab1-6358d56ce05f service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7bf789f8-3675-489e-b9b2-9cc639bde4b0 req-54181d5c-4f82-4c7c-bab1-6358d56ce05f service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-7bf789f8-3675-489e-b9b2-9cc639bde4b0 req-54181d5c-4f82-4c7c-bab1-6358d56ce05f service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-unplugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:27 user nova-compute[73254]: WARNING nova.compute.manager [req-7bf789f8-3675-489e-b9b2-9cc639bde4b0 req-54181d5c-4f82-4c7c-bab1-6358d56ce05f service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-unplugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state active and task_state rescuing.
Aug 14 15:09:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Instance destroyed successfully.
Aug 14 15:09:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Attempting a stable device rescue
Aug 14 15:09:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73254) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 15:09:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Instance directory exists: not creating {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 15:09:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Creating image(s)
Aug 14 15:09:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "/opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "/opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "/opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:28 user nova-compute[73254]: DEBUG nova.objects.instance [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'trusted_certs' on Instance uuid ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "9fbab118b1236fd554d25752bfcfb63d2d092fd7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "9fbab118b1236fd554d25752bfcfb63d2d092fd7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7.part --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-beaa4d0f-8178-45cd-8b2b-c016f78fb784 req-7543d5db-273c-4d66-9877-bf50b3f80529 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-beaa4d0f-8178-45cd-8b2b-c016f78fb784 req-7543d5db-273c-4d66-9877-bf50b3f80529 service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-beaa4d0f-8178-45cd-8b2b-c016f78fb784 req-7543d5db-273c-4d66-9877-bf50b3f80529 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-beaa4d0f-8178-45cd-8b2b-c016f78fb784 req-7543d5db-273c-4d66-9877-bf50b3f80529 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-beaa4d0f-8178-45cd-8b2b-c016f78fb784 req-7543d5db-273c-4d66-9877-bf50b3f80529 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:30 user nova-compute[73254]: WARNING nova.compute.manager [req-beaa4d0f-8178-45cd-8b2b-c016f78fb784 req-7543d5db-273c-4d66-9877-bf50b3f80529 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state active and task_state rescuing.
Aug 14 15:09:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01773c99-e739-4da9-8c0b-493556a46e2d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:30 user nova-compute[73254]: INFO nova.compute.manager [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Unshelving
Aug 14 15:09:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7.part --force-share --output=json" returned: 0 in 0.278s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG nova.virt.images [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] 248c3a8d-7ac0-468b-897b-0507c410ce2a was qcow2, converting to raw {{(pid=73254) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7.part /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7.converted {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'pci_requests' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'numa_topology' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:30 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:09:30 user nova-compute[73254]: INFO nova.compute.claims [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Claim successful on node user
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7.part /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7.converted" returned: 0 in 0.761s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7.converted --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7.converted --force-share --output=json" returned: 0 in 0.359s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "9fbab118b1236fd554d25752bfcfb63d2d092fd7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.979s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "9fbab118b1236fd554d25752bfcfb63d2d092fd7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "9fbab118b1236fd554d25752bfcfb63d2d092fd7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:31 user nova-compute[73254]: INFO nova.compute.manager [None req-6ac87b36-47d0-4567-833e-ce1028ca5741 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Unrescuing
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ac87b36-47d0-4567-833e-ce1028ca5741 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ac87b36-47d0-4567-833e-ce1028ca5741 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquired lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG nova.network.neutron [None req-6ac87b36-47d0-4567-833e-ce1028ca5741 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7 --force-share --output=json" returned: 0 in 0.310s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7,backing_fmt=raw /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.472s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7,backing_fmt=raw /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue" returned: 0 in 0.115s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "9fbab118b1236fd554d25752bfcfb63d2d092fd7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.429s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:31 user nova-compute[73254]: DEBUG nova.objects.instance [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'migration_context' on Instance uuid ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Start _get_guest_xml network_info=[{"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "vif_mac": "fa:16:3e:85:50:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '248c3a8d-7ac0-468b-897b-0507c410ce2a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a859e7f3-01df-4b62-bed8-a4aef1f54c33', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUauhwsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f', 'attached_at': '', 'detached_at': '', 'volume_id': '850bef41-dcbb-48a6-b505-c81868961600', 'serial': '850bef41-dcbb-48a6-b505-c81868961600'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.objects.instance [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'resources' on Instance uuid ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.objects.instance [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'numa_topology' on Instance uuid ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:32 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:09:32 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:09:32 user nova-compute[73254]: INFO nova.network.neutron [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updating port 7c5be923-e482-480c-881d-36637fb4d86c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.objects.instance [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'vcpu_model' on Instance uuid ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUauhwsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:09:32 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:09:32 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:09:32 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6ce2e8-87f2-4f52-b2c7-1303516ad244]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kUauhwsf\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 15:09:32 user nova-compute[73254]: node.name = iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600
Aug 14 15:09:32 user nova-compute[73254]: node.tpgt = -1
Aug 14 15:09:32 user nova-compute[73254]: node.startup = automatic
Aug 14 15:09:32 user nova-compute[73254]: node.leading_login = No
Aug 14 15:09:32 user nova-compute[73254]: iface.iscsi_ifacename = default
Aug 14 15:09:32 user nova-compute[73254]: iface.net_ifacename = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.ipaddress = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.prefix_len = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.hwaddress = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.transport_name = tcp
Aug 14 15:09:32 user nova-compute[73254]: iface.initiatorname = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.state = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.vlan_id = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.vlan_priority = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.vlan_state = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.iface_num = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.mtu = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.port = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.bootproto = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.subnet_mask = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.gateway = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.dhcp_alt_client_id = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.dhcp_dns = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.dhcp_learn_iqn = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.dhcp_vendor_id_state = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.dhcp_vendor_id = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.dhcp_slp_da = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.fragmentation = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.gratuitous_arp = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.incoming_forwarding = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.tos_state = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.tos = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.ttl = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.delayed_ack = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.tcp_nagle = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.tcp_wsf_state = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.tcp_wsf = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.tcp_timer_scale = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.tcp_timestamp = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.redirect = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.def_task_mgmt_timeout = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.header_digest = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.data_digest = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.immediate_data = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.initial_r2t = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.data_seq_inorder = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.data_pdu_inorder = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.erl = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.max_receive_data_len = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.first_burst_len = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.max_outstanding_r2t = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.max_burst_len = 0
Aug 14 15:09:32 user nova-compute[73254]: iface.chap_auth = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.bidi_chap = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.strict_login_compliance = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.discovery_auth = <empty>
Aug 14 15:09:32 user nova-compute[73254]: iface.discovery_logout = <empty>
Aug 14 15:09:32 user nova-compute[73254]: node.discovery_address = <empty>
Aug 14 15:09:32 user nova-compute[73254]: node.discovery_port = 0
Aug 14 15:09:32 user nova-compute[73254]: node.discovery_type = static
Aug 14 15:09:32 user nova-compute[73254]: node.session.initial_cmdsn = 0
Aug 14 15:09:32 user nova-compute[73254]: node.session.initial_login_retry_max = 8
Aug 14 15:09:32 user nova-compute[73254]: node.session.xmit_thread_priority = -20
Aug 14 15:09:32 user nova-compute[73254]: node.session.cmds_max = 128
Aug 14 15:09:32 user nova-compute[73254]: node.session.queue_depth = 32
Aug 14 15:09:32 user nova-compute[73254]: node.session.nr_sessions = 1
Aug 14 15:09:32 user nova-compute[73254]: node.session.auth.authmethod = CHAP
Aug 14 15:09:32 user nova-compute[73254]: node.session.auth.username = kUauhwsf
Aug 14 15:09:32 user nova-compute[73254]: node.session.auth.password = ***
Aug 14 15:09:32 user nova-compute[73254]: node.session.auth.username_in = <empty>
Aug 14 15:09:32 user nova-compute[73254]: node.session.auth.password_in = <empty>
Aug 14 15:09:32 user nova-compute[73254]: node.session.auth.chap_algs = MD5
Aug 14 15:09:32 user nova-compute[73254]: node.session.timeo.replacement_timeout = 120
Aug 14 15:09:32 user nova-compute[73254]: node.session.err_timeo.abort_timeout = 15
Aug 14 15:09:32 user nova-compute[73254]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 15:09:32 user nova-compute[73254]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 15:09:32 user nova-compute[73254]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 15:09:32 user nova-compute[73254]: node.session.iscsi.FastAbort = Yes
Aug 14 15:09:32 user nova-compute[73254]: node.session.iscsi.InitialR2T = No
Aug 14 15:09:32 user nova-compute[73254]: node.session.iscsi.ImmediateData = Yes
Aug 14 15:09:32 user nova-compute[73254]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 15:09:32 user nova-compute[73254]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 15:09:32 user nova-compute[73254]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 15:09:32 user nova-compute[73254]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 15:09:32 user nova-compute[73254]: node.session.iscsi.MaxConnections = 1
Aug 14 15:09:32 user nova-compute[73254]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 15:09:32 user nova-compute[73254]: node.session.iscsi.ERL = 0
Aug 14 15:09:32 user nova-compute[73254]: node.session.scan = manual
Aug 14 15:09:32 user nova-compute[73254]: node.session.reopen_max = 0
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].address = 172.16.0.220
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].port = 3260
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].startup = manual
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].tcp.window_size = 524288
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].tcp.type_of_service = 0
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].timeo.logout_timeout = 15
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].timeo.login_timeout = 15
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].timeo.auth_timeout = 45
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].iscsi.DataDigest = None
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].iscsi.IFMarker = No
Aug 14 15:09:32 user nova-compute[73254]: node.conn[0].iscsi.OFMarker = No
Aug 14 15:09:32 user nova-compute[73254]: # END RECORD
Aug 14 15:09:32 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.151s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5159f5e7-6fd9-44a3-8452-f71ac9471217]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f530c14d-662b-45f8-bf7f-c19c6d1e4a4e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUauhwsf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kUauhwsf" returned: 0 in 0.069s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[71dc275c-2551-4ad7-a767-829ccda833e3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kUauhwsf'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[94501548-de97-443a-b9cc-4ce3f3d60b6b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6028bf78-0b8e-455e-8539-4f026795e52f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:09:32 user nova-compute[73254]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:09:32 user nova-compute[73254]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)
Aug 14 15:09:32 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:09:32 user nova-compute[73254]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:09:32 user nova-compute[73254]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)
Aug 14 15:09:32 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] HCTL ('34', '0', '0', 0) found on session 26 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.network.neutron [None req-6ac87b36-47d0-4567-833e-ce1028ca5741 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updating instance_info_cache with network_info: [{"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[413a0eee-e754-4d10-b139-4ed8354402af]: (4, ('0 0 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching for a device in session 26 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUauhwsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.424s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] <== connect_volume: return (426ms) {'type': 'block', 'scsi_wwn': '26266636164323834', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266636164323834', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6ac87b36-47d0-4567-833e-ce1028ca5741 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Releasing lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6ac87b36-47d0-4567-833e-ce1028ca5741 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'flavor' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1607424910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1607424910',id=27,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:08:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-e2ytg44n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:08:07Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "vif_mac": "fa:16:3e:85:50:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "vif_mac": "fa:16:3e:85:50:48"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:50:48,bridge_name='br-int',has_traffic_filtering=True,id=46821c5a-d60c-47a2-8b4b-500198ccc670,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46821c5a-d6') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.objects.instance [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'pci_devices' on Instance uuid ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:09:32 user nova-compute[73254]:   <uuid>ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f</uuid>
Aug 14 15:09:32 user nova-compute[73254]:   <name>instance-0000001b</name>
Aug 14 15:09:32 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:09:32 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:09:32 user nova-compute[73254]:   <metadata>
Aug 14 15:09:32 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:09:32 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:09:32 user nova-compute[73254]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1607424910</nova:name>
Aug 14 15:09:32 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:09:32</nova:creationTime>
Aug 14 15:09:32 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:09:32 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:09:32 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:09:32 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:09:32 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:09:32 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:09:32 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:09:32 user nova-compute[73254]:       <nova:owner>
Aug 14 15:09:32 user nova-compute[73254]:         <nova:user uuid="4ca9fb4530574c44b1a3cfa6e1b90871">tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member</nova:user>
Aug 14 15:09:32 user nova-compute[73254]:         <nova:project uuid="7879ba4750fa40cf9ee6bfb1daf85fdf">tempest-ServerBootFromVolumeStableRescueTest-1955280356</nova:project>
Aug 14 15:09:32 user nova-compute[73254]:       </nova:owner>
Aug 14 15:09:32 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:09:32 user nova-compute[73254]:       <nova:ports>
Aug 14 15:09:32 user nova-compute[73254]:         <nova:port uuid="46821c5a-d60c-47a2-8b4b-500198ccc670">
Aug 14 15:09:32 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 15:09:32 user nova-compute[73254]:         </nova:port>
Aug 14 15:09:32 user nova-compute[73254]:       </nova:ports>
Aug 14 15:09:32 user nova-compute[73254]:     </nova:instance>
Aug 14 15:09:32 user nova-compute[73254]:   </metadata>
Aug 14 15:09:32 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:09:32 user nova-compute[73254]:     <system>
Aug 14 15:09:32 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:09:32 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:09:32 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:09:32 user nova-compute[73254]:       <entry name="serial">ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f</entry>
Aug 14 15:09:32 user nova-compute[73254]:       <entry name="uuid">ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f</entry>
Aug 14 15:09:32 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:09:32 user nova-compute[73254]:     </system>
Aug 14 15:09:32 user nova-compute[73254]:   </sysinfo>
Aug 14 15:09:32 user nova-compute[73254]:   <os>
Aug 14 15:09:32 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:09:32 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:09:32 user nova-compute[73254]:   </os>
Aug 14 15:09:32 user nova-compute[73254]:   <features>
Aug 14 15:09:32 user nova-compute[73254]:     <acpi/>
Aug 14 15:09:32 user nova-compute[73254]:     <apic/>
Aug 14 15:09:32 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:09:32 user nova-compute[73254]:   </features>
Aug 14 15:09:32 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:09:32 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:09:32 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:09:32 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:09:32 user nova-compute[73254]:   </clock>
Aug 14 15:09:32 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:09:32 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:09:32 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:09:32 user nova-compute[73254]:   </cpu>
Aug 14 15:09:32 user nova-compute[73254]:   <devices>
Aug 14 15:09:32 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:09:32 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:09:32 user nova-compute[73254]:       <source dev="/dev/sdc"/>
Aug 14 15:09:32 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:09:32 user nova-compute[73254]:       <serial>850bef41-dcbb-48a6-b505-c81868961600</serial>
Aug 14 15:09:32 user nova-compute[73254]:     </disk>
Aug 14 15:09:32 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:09:32 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:09:32 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue"/>
Aug 14 15:09:32 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:09:32 user nova-compute[73254]:       <boot order="1"/>
Aug 14 15:09:32 user nova-compute[73254]:     </disk>
Aug 14 15:09:32 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:09:32 user nova-compute[73254]:       <mac address="fa:16:3e:85:50:48"/>
Aug 14 15:09:32 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:09:32 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:09:32 user nova-compute[73254]:       <target dev="tap46821c5a-d6"/>
Aug 14 15:09:32 user nova-compute[73254]:     </interface>
Aug 14 15:09:32 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:09:32 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/console.log" append="off"/>
Aug 14 15:09:32 user nova-compute[73254]:     </serial>
Aug 14 15:09:32 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:09:32 user nova-compute[73254]:     <video>
Aug 14 15:09:32 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:09:32 user nova-compute[73254]:     </video>
Aug 14 15:09:32 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:09:32 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:09:32 user nova-compute[73254]:     </rng>
Aug 14 15:09:32 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:09:32 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:09:32 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:09:32 user nova-compute[73254]:     </memballoon>
Aug 14 15:09:32 user nova-compute[73254]:   </devices>
Aug 14 15:09:32 user nova-compute[73254]: </domain>
Aug 14 15:09:32 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:09:32 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Instance destroyed successfully.
Aug 14 15:09:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No VIF found with MAC fa:16:3e:85:50:48, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:09:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-70e6bbfc-bf91-44d4-9bc3-15dc6319e35d req-1252b82c-626a-4ce0-93d9-7d7bc5ca55c8 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-unplugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-70e6bbfc-bf91-44d4-9bc3-15dc6319e35d req-1252b82c-626a-4ce0-93d9-7d7bc5ca55c8 service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-70e6bbfc-bf91-44d4-9bc3-15dc6319e35d req-1252b82c-626a-4ce0-93d9-7d7bc5ca55c8 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-70e6bbfc-bf91-44d4-9bc3-15dc6319e35d req-1252b82c-626a-4ce0-93d9-7d7bc5ca55c8 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-70e6bbfc-bf91-44d4-9bc3-15dc6319e35d req-1252b82c-626a-4ce0-93d9-7d7bc5ca55c8 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-unplugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:33 user nova-compute[73254]: WARNING nova.compute.manager [req-70e6bbfc-bf91-44d4-9bc3-15dc6319e35d req-1252b82c-626a-4ce0-93d9-7d7bc5ca55c8 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-unplugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:09:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquired lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-74835ba9-b8ac-4b2d-b570-4b218f7a30b0 req-bb6e9b9c-dfbb-4d4b-a9b5-36771ecc185f service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-changed-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-74835ba9-b8ac-4b2d-b570-4b218f7a30b0 req-bb6e9b9c-dfbb-4d4b-a9b5-36771ecc185f service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Refreshing instance network info cache due to event network-changed-7c5be923-e482-480c-881d-36637fb4d86c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:09:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-74835ba9-b8ac-4b2d-b570-4b218f7a30b0 req-bb6e9b9c-dfbb-4d4b-a9b5-36771ecc185f service nova] Acquiring lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:09:34 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updating instance_info_cache with network_info: [{"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Releasing lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:09:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:09:34 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Creating image(s)
Aug 14 15:09:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "/opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "/opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "/opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:34 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'trusted_certs' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-74835ba9-b8ac-4b2d-b570-4b218f7a30b0 req-bb6e9b9c-dfbb-4d4b-a9b5-36771ecc185f service nova] Acquired lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:09:34 user nova-compute[73254]: DEBUG nova.network.neutron [req-74835ba9-b8ac-4b2d-b570-4b218f7a30b0 req-bb6e9b9c-dfbb-4d4b-a9b5-36771ecc185f service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Refreshing network info cache for port 7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:09:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "32ccd76e71d55e429484cd8917e797acdd49f809" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "32ccd76e71d55e429484cd8917e797acdd49f809" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:34 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Instance destroyed successfully.
Aug 14 15:09:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809.part --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-9d3815c4-b1e1-4388-bc49-431c2d7e5123 req-5e73437b-9de9-42a1-a75e-8cdb28db9cfb service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d3815c4-b1e1-4388-bc49-431c2d7e5123 req-5e73437b-9de9-42a1-a75e-8cdb28db9cfb service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d3815c4-b1e1-4388-bc49-431c2d7e5123 req-5e73437b-9de9-42a1-a75e-8cdb28db9cfb service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d3815c4-b1e1-4388-bc49-431c2d7e5123 req-5e73437b-9de9-42a1-a75e-8cdb28db9cfb service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-9d3815c4-b1e1-4388-bc49-431c2d7e5123 req-5e73437b-9de9-42a1-a75e-8cdb28db9cfb service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:35 user nova-compute[73254]: WARNING nova.compute.manager [req-9d3815c4-b1e1-4388-bc49-431c2d7e5123 req-5e73437b-9de9-42a1-a75e-8cdb28db9cfb service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:09:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809.part --force-share --output=json" returned: 0 in 0.274s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:35 user nova-compute[73254]: DEBUG nova.virt.images [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] 8b5dad18-9ca9-4a97-8e97-a690a41d05c5 was qcow2, converting to raw {{(pid=73254) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 15:09:35 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:09:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809.part /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809.converted {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG nova.network.neutron [req-74835ba9-b8ac-4b2d-b570-4b218f7a30b0 req-bb6e9b9c-dfbb-4d4b-a9b5-36771ecc185f service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updated VIF entry in instance network info cache for port 7c5be923-e482-480c-881d-36637fb4d86c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG nova.network.neutron [req-74835ba9-b8ac-4b2d-b570-4b218f7a30b0 req-bb6e9b9c-dfbb-4d4b-a9b5-36771ecc185f service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updating instance_info_cache with network_info: [{"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-74835ba9-b8ac-4b2d-b570-4b218f7a30b0 req-bb6e9b9c-dfbb-4d4b-a9b5-36771ecc185f service nova] Releasing lock "refresh_cache-01773c99-e739-4da9-8c0b-493556a46e2d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025761.2667284, 66358584-2d11-4ea0-9ab9-b64eb358c1f9 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:36 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] VM Stopped (Lifecycle Event)
Aug 14 15:09:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-39d2d19e-f093-4170-b1c3-1370258ab1e7 None None] [instance: 66358584-2d11-4ea0-9ab9-b64eb358c1f9] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809.part /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809.converted" returned: 0 in 1.421s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809.converted --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "32ccd76e71d55e429484cd8917e797acdd49f809" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.231s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:37 user nova-compute[73254]: WARNING nova.compute.manager [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state active and task_state rescuing.
Aug 14 15:09:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:37 user nova-compute[73254]: WARNING nova.compute.manager [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state active and task_state rescuing.
Aug 14 15:09:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:37 user nova-compute[73254]: WARNING nova.compute.manager [req-49047233-2aa4-4aa5-95f9-d9f75d19b03b req-a4bbd30c-e5a3-430f-bdaa-89ddffc16e96 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809 --force-share --output=json" returned: 0 in 0.257s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "32ccd76e71d55e429484cd8917e797acdd49f809" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "32ccd76e71d55e429484cd8917e797acdd49f809" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809 --force-share --output=json" returned: 0 in 0.251s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809,backing_fmt=raw /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809,backing_fmt=raw /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk 1073741824" returned: 0 in 0.074s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "32ccd76e71d55e429484cd8917e797acdd49f809" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809 --force-share --output=json" returned: 0 in 0.227s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:38 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'migration_context' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:38 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Rebasing disk image.
Aug 14 15:09:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc -F raw /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-f8c87451-0b44-44bb-9fe0-2e94274db0fb req-96b4692c-4c12-4ef3-859e-a54ee5160a73 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f8c87451-0b44-44bb-9fe0-2e94274db0fb req-96b4692c-4c12-4ef3-859e-a54ee5160a73 service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f8c87451-0b44-44bb-9fe0-2e94274db0fb req-96b4692c-4c12-4ef3-859e-a54ee5160a73 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f8c87451-0b44-44bb-9fe0-2e94274db0fb req-96b4692c-4c12-4ef3-859e-a54ee5160a73 service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-f8c87451-0b44-44bb-9fe0-2e94274db0fb req-96b4692c-4c12-4ef3-859e-a54ee5160a73 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:39 user nova-compute[73254]: WARNING nova.compute.manager [req-f8c87451-0b44-44bb-9fe0-2e94274db0fb req-96b4692c-4c12-4ef3-859e-a54ee5160a73 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025779.6677778, ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:39 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] VM Resumed (Lifecycle Event)
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-8a32f47c-02da-41bb-835d-835d259f571d tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:39 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025779.6820338, ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:39 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] VM Started (Lifecycle Event)
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6ac87b36-47d0-4567-833e-ce1028ca5741 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for 81ebd5b0-2b15-4dcd-801f-12f89938794c due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025779.8110151, 81ebd5b0-2b15-4dcd-801f-12f89938794c => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:39 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] VM Resumed (Lifecycle Event)
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:39 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 15:09:39 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025779.8120506, 81ebd5b0-2b15-4dcd-801f-12f89938794c => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:39 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] VM Started (Lifecycle Event)
Aug 14 15:09:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:40 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 15:09:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc -F raw /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk" returned: 0 in 3.554s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:09:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:09:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Ensure instance console log exists: /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:09:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Start _get_guest_xml network_info=[{"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='be7c6b85ea7d46ae3a84922360a48649',container_format='bare',created_at=2023-08-14T15:07:35Z,direct_url=<?>,disk_format='qcow2',id=8b5dad18-9ca9-4a97-8e97-a690a41d05c5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1981963554-shelved',owner='3ac5a724189545548484fba6d4e0c842',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T15:07:40Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:09:42 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:09:42 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='be7c6b85ea7d46ae3a84922360a48649',container_format='bare',created_at=2023-08-14T15:07:35Z,direct_url=<?>,disk_format='qcow2',id=8b5dad18-9ca9-4a97-8e97-a690a41d05c5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1981963554-shelved',owner='3ac5a724189545548484fba6d4e0c842',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-08-14T15:07:40Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'vcpu_model' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T15:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1981963554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1981963554',id=23,image_ref='8b5dad18-9ca9-4a97-8e97-a690a41d05c5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1788138174',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:05:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-u0ndwxw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member',shelved_at='2023-08-14T15:07:40.278726',shelved_host='user',shelved_image_id='8b5dad18-9ca9-4a97-8e97-a690a41d05c5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01773c99-e739-4da9-8c0b-493556a46e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'pci_devices' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:09:42 user nova-compute[73254]:   <uuid>01773c99-e739-4da9-8c0b-493556a46e2d</uuid>
Aug 14 15:09:42 user nova-compute[73254]:   <name>instance-00000017</name>
Aug 14 15:09:42 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:09:42 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:09:42 user nova-compute[73254]:   <metadata>
Aug 14 15:09:42 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:09:42 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:09:42 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1981963554</nova:name>
Aug 14 15:09:42 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:09:42</nova:creationTime>
Aug 14 15:09:42 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:09:42 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:09:42 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:09:42 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:09:42 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:09:42 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:09:42 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:09:42 user nova-compute[73254]:       <nova:owner>
Aug 14 15:09:42 user nova-compute[73254]:         <nova:user uuid="abc1e49d76ae4690b8ab6b1dd5ec5eae">tempest-AttachVolumeShelveTestJSON-960640486-project-member</nova:user>
Aug 14 15:09:42 user nova-compute[73254]:         <nova:project uuid="3ac5a724189545548484fba6d4e0c842">tempest-AttachVolumeShelveTestJSON-960640486</nova:project>
Aug 14 15:09:42 user nova-compute[73254]:       </nova:owner>
Aug 14 15:09:42 user nova-compute[73254]:       <nova:root type="image" uuid="8b5dad18-9ca9-4a97-8e97-a690a41d05c5"/>
Aug 14 15:09:42 user nova-compute[73254]:       <nova:ports>
Aug 14 15:09:42 user nova-compute[73254]:         <nova:port uuid="7c5be923-e482-480c-881d-36637fb4d86c">
Aug 14 15:09:42 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 15:09:42 user nova-compute[73254]:         </nova:port>
Aug 14 15:09:42 user nova-compute[73254]:       </nova:ports>
Aug 14 15:09:42 user nova-compute[73254]:     </nova:instance>
Aug 14 15:09:42 user nova-compute[73254]:   </metadata>
Aug 14 15:09:42 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:09:42 user nova-compute[73254]:     <system>
Aug 14 15:09:42 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:09:42 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:09:42 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:09:42 user nova-compute[73254]:       <entry name="serial">01773c99-e739-4da9-8c0b-493556a46e2d</entry>
Aug 14 15:09:42 user nova-compute[73254]:       <entry name="uuid">01773c99-e739-4da9-8c0b-493556a46e2d</entry>
Aug 14 15:09:42 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:09:42 user nova-compute[73254]:     </system>
Aug 14 15:09:42 user nova-compute[73254]:   </sysinfo>
Aug 14 15:09:42 user nova-compute[73254]:   <os>
Aug 14 15:09:42 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:09:42 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:09:42 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:09:42 user nova-compute[73254]:   </os>
Aug 14 15:09:42 user nova-compute[73254]:   <features>
Aug 14 15:09:42 user nova-compute[73254]:     <acpi/>
Aug 14 15:09:42 user nova-compute[73254]:     <apic/>
Aug 14 15:09:42 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:09:42 user nova-compute[73254]:   </features>
Aug 14 15:09:42 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:09:42 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:09:42 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:09:42 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:09:42 user nova-compute[73254]:   </clock>
Aug 14 15:09:42 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:09:42 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:09:42 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:09:42 user nova-compute[73254]:   </cpu>
Aug 14 15:09:42 user nova-compute[73254]:   <devices>
Aug 14 15:09:42 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:09:42 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:09:42 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk"/>
Aug 14 15:09:42 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:09:42 user nova-compute[73254]:     </disk>
Aug 14 15:09:42 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:09:42 user nova-compute[73254]:       <mac address="fa:16:3e:bc:6e:cb"/>
Aug 14 15:09:42 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:09:42 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:09:42 user nova-compute[73254]:       <target dev="tap7c5be923-e4"/>
Aug 14 15:09:42 user nova-compute[73254]:     </interface>
Aug 14 15:09:42 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:09:42 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/console.log" append="off"/>
Aug 14 15:09:42 user nova-compute[73254]:     </serial>
Aug 14 15:09:42 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:09:42 user nova-compute[73254]:     <video>
Aug 14 15:09:42 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:09:42 user nova-compute[73254]:     </video>
Aug 14 15:09:42 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:09:42 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:09:42 user nova-compute[73254]:     </rng>
Aug 14 15:09:42 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:09:42 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:09:42 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:09:42 user nova-compute[73254]:     </memballoon>
Aug 14 15:09:42 user nova-compute[73254]:   </devices>
Aug 14 15:09:42 user nova-compute[73254]: </domain>
Aug 14 15:09:42 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T15:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1981963554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1981963554',id=23,image_ref='8b5dad18-9ca9-4a97-8e97-a690a41d05c5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1788138174',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:05:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-u0ndwxw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member',shelved_at='2023-08-14T15:07:40.278726',shelved_host='user',shelved_image_id='8b5dad18-9ca9-4a97-8e97-a690a41d05c5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:09:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01773c99-e739-4da9-8c0b-493556a46e2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG os_vif [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c5be923-e4, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c5be923-e4, col_values=(('external_ids', {'iface-id': '7c5be923-e482-480c-881d-36637fb4d86c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:6e:cb', 'vm-uuid': '01773c99-e739-4da9-8c0b-493556a46e2d'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:42 user nova-compute[73254]: INFO os_vif [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4')
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:09:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] No VIF found with MAC fa:16:3e:bc:6e:cb, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:09:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-2be64a16-f0e6-4913-a5be-ef574899669f req-e3ac3ca0-747b-48f1-833a-71c8598f1f2e service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2be64a16-f0e6-4913-a5be-ef574899669f req-e3ac3ca0-747b-48f1-833a-71c8598f1f2e service nova] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2be64a16-f0e6-4913-a5be-ef574899669f req-e3ac3ca0-747b-48f1-833a-71c8598f1f2e service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2be64a16-f0e6-4913-a5be-ef574899669f req-e3ac3ca0-747b-48f1-833a-71c8598f1f2e service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-2be64a16-f0e6-4913-a5be-ef574899669f req-e3ac3ca0-747b-48f1-833a-71c8598f1f2e service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] No waiting events found dispatching network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:44 user nova-compute[73254]: WARNING nova.compute.manager [req-2be64a16-f0e6-4913-a5be-ef574899669f req-e3ac3ca0-747b-48f1-833a-71c8598f1f2e service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received unexpected event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 15:09:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-71f7286e-2548-4801-9416-164de857e60a req-76011db1-0f5b-4d6d-bc4f-dab1f5addf8c service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:09:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-71f7286e-2548-4801-9416-164de857e60a req-76011db1-0f5b-4d6d-bc4f-dab1f5addf8c service nova] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:09:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-71f7286e-2548-4801-9416-164de857e60a req-76011db1-0f5b-4d6d-bc4f-dab1f5addf8c service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:09:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-71f7286e-2548-4801-9416-164de857e60a req-76011db1-0f5b-4d6d-bc4f-dab1f5addf8c service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-71f7286e-2548-4801-9416-164de857e60a req-76011db1-0f5b-4d6d-bc4f-dab1f5addf8c service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] No waiting events found dispatching network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:09:46 user nova-compute[73254]: WARNING nova.compute.manager [req-71f7286e-2548-4801-9416-164de857e60a req-76011db1-0f5b-4d6d-bc4f-dab1f5addf8c service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received unexpected event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025786.480057, 01773c99-e739-4da9-8c0b-493556a46e2d => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:46 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] VM Resumed (Lifecycle Event)
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:09:46 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Instance spawned successfully.
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:46 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025786.4828286, 01773c99-e739-4da9-8c0b-493556a46e2d => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:09:46 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] VM Started (Lifecycle Event)
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:09:46 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:09:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:09:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c92b0390-bdb1-40b3-a371-faf91d14cd44 tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01773c99-e739-4da9-8c0b-493556a46e2d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.952s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:09:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:09:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:00 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:10:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:00 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:10:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:06 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:10:06 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=6989MB free_disk=25.06039047241211GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 456882f8-f70c-4a85-b593-c1066e732a9e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a4fe3ea7-bf03-486f-8a84-fb4867a6fc52 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a651971c-b3b5-490b-b09e-6f93be59c663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 01773c99-e739-4da9-8c0b-493556a46e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:06 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:10:07 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:10:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:10:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.700s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:10:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:09 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:10:09 user nova-compute[73254]: INFO nova.compute.claims [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Claim successful on node user
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.576s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:10:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:10:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Creating image(s)
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "/opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "/opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.policy [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c372e49b3d04765aa35916ba8e2e0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d51019cbe3a4ce694c44fd294c26e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Updating instance_info_cache with network_info: [{"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.223s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk 1073741824" returned: 0 in 0.249s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.480s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Cannot resize image /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG nova.objects.instance [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'migration_context' on Instance uuid e1e2c36c-4583-4c4b-bc16-38b891a1be78 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Ensure instance console log exists: /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Successfully created port: fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:11 user nova-compute[73254]: INFO nova.compute.manager [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Detaching volume b79a6e32-757f-490f-88ba-79e49b0c464f
Aug 14 15:10:11 user nova-compute[73254]: INFO nova.virt.block_device [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Attempting to driver detach volume b79a6e32-757f-490f-88ba-79e49b0c464f from mountpoint /dev/vdb
Aug 14 15:10:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Attempting to detach device vdb from instance 456882f8-f70c-4a85-b593-c1066e732a9e from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:10:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:10:11 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:10:11 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:10:11 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:10:11 user nova-compute[73254]:   <serial>b79a6e32-757f-490f-88ba-79e49b0c464f</serial>
Aug 14 15:10:11 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:10:11 user nova-compute[73254]: </disk>
Aug 14 15:10:11 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:10:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully detached device vdb from instance 456882f8-f70c-4a85-b593-c1066e732a9e from the persistent domain config.
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 456882f8-f70c-4a85-b593-c1066e732a9e from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:10:12 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:10:12 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:10:12 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:10:12 user nova-compute[73254]:   <serial>b79a6e32-757f-490f-88ba-79e49b0c464f</serial>
Aug 14 15:10:12 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:10:12 user nova-compute[73254]: </disk>
Aug 14 15:10:12 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025812.4250438, 456882f8-f70c-4a85-b593-c1066e732a9e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 456882f8-f70c-4a85-b593-c1066e732a9e {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:10:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully detached device vdb from instance 456882f8-f70c-4a85-b593-c1066e732a9e from the live domain config.
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CLPJkpay', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:10:12 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bc9cd4-103d-4c01-833d-e37f4406739c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa711ac-1756-40e5-9cda-4546ae29c7d6\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3851ac13-8ff0-478d-8521-275c1cc4c4aa]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa711ac-1756-40e5-9cda-4546ae29c7d6 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:10:12 user nova-compute[73254]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:10:12 user nova-compute[73254]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)
Aug 14 15:10:12 user nova-compute[73254]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa711ac-1756-40e5-9cda-4546ae29c7d6 (non-flash)
Aug 14 15:10:12 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f (non-flash)
Aug 14 15:10:12 user nova-compute[73254]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:10:12 user nova-compute[73254]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)
Aug 14 15:10:12 user nova-compute[73254]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa711ac-1756-40e5-9cda-4546ae29c7d6 (non-flash)
Aug 14 15:10:12 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6684ee9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7b107d-a93d-49aa-9a75-f32b0fc999df]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5e0d7e-9ffa-4f46-a0c4-0486a5794599]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54649ce-6c54-4c93-b694-9f99fa25d0a1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2042f590-1b8e-4bf6-a9a2-a8bcec17994a]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[57786b0d-9f2f-4aca-8df9-1cc45af05b18]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Successfully updated port: fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "refresh_cache-e1e2c36c-4583-4c4b-bc16-38b891a1be78" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquired lock "refresh_cache-e1e2c36c-4583-4c4b-bc16-38b891a1be78" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[16025f13-1a74-48ec-a4ef-917b6df5f990]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f, portal: 172.16.0.220,3260]
Aug 14 15:10:12 user nova-compute[73254]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f, portal: 172.16.0.220,3260] successful.
Aug 14 15:10:12 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-d9022cb1-1740-409d-9b60-8a766251d422 req-c17c3cb9-d699-4a99-9a21-7e1c5883f61e service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received event network-changed-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-d9022cb1-1740-409d-9b60-8a766251d422 req-c17c3cb9-d699-4a99-9a21-7e1c5883f61e service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Refreshing instance network info cache due to event network-changed-fd7dd171-0b9c-474e-9f9f-15662377fdae. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d9022cb1-1740-409d-9b60-8a766251d422 req-c17c3cb9-d699-4a99-9a21-7e1c5883f61e service nova] Acquiring lock "refresh_cache-e1e2c36c-4583-4c4b-bc16-38b891a1be78" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b79a6e32-757f-490f-88ba-79e49b0c464f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a9e430-b3a6-49ae-94b2-ad38641000aa]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] <== disconnect_volume: return (299ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:10:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.network.neutron [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Updating instance_info_cache with network_info: [{"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Releasing lock "refresh_cache-e1e2c36c-4583-4c4b-bc16-38b891a1be78" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Instance network_info: |[{"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d9022cb1-1740-409d-9b60-8a766251d422 req-c17c3cb9-d699-4a99-9a21-7e1c5883f61e service nova] Acquired lock "refresh_cache-e1e2c36c-4583-4c4b-bc16-38b891a1be78" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-d9022cb1-1740-409d-9b60-8a766251d422 req-c17c3cb9-d699-4a99-9a21-7e1c5883f61e service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Refreshing network info cache for port fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Start _get_guest_xml network_info=[{"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:10:13 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:10:13 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1314775822',display_name='tempest-VolumesSnapshotTestJSON-instance-1314775822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1314775822',id=31,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLb6YvHjwrNCwLKhT3FaZBVHLfLPSRf6jAH1DoViJryeY48WglvbVCCZ0C7WDmcg5aStfbcEc4a1/6LkjRjo0ssyVFHpqn3c5rINtHlNvEFNDb22jgnmItN6T9si/gdQ==',key_name='tempest-keypair-1269624836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d51019cbe3a4ce694c44fd294c26e76',ramdisk_id='',reservation_id='r-r070f7sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1785106285',owner_user_name='tempest-VolumesSnapshotTestJSON-1785106285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c372e49b3d04765aa35916ba8e2e0f8',uuid=e1e2c36c-4583-4c4b-bc16-38b891a1be78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converting VIF {"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:9d:8e,bridge_name='br-int',has_traffic_filtering=True,id=fd7dd171-0b9c-474e-9f9f-15662377fdae,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dd171-0b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.objects.instance [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'pci_devices' on Instance uuid e1e2c36c-4583-4c4b-bc16-38b891a1be78 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:10:13 user nova-compute[73254]:   <uuid>e1e2c36c-4583-4c4b-bc16-38b891a1be78</uuid>
Aug 14 15:10:13 user nova-compute[73254]:   <name>instance-0000001f</name>
Aug 14 15:10:13 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:10:13 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:10:13 user nova-compute[73254]:   <metadata>
Aug 14 15:10:13 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:10:13 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:10:13 user nova-compute[73254]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1314775822</nova:name>
Aug 14 15:10:13 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:10:13</nova:creationTime>
Aug 14 15:10:13 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:10:13 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:10:13 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:10:13 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:10:13 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:10:13 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:10:13 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:10:13 user nova-compute[73254]:       <nova:owner>
Aug 14 15:10:13 user nova-compute[73254]:         <nova:user uuid="9c372e49b3d04765aa35916ba8e2e0f8">tempest-VolumesSnapshotTestJSON-1785106285-project-member</nova:user>
Aug 14 15:10:13 user nova-compute[73254]:         <nova:project uuid="3d51019cbe3a4ce694c44fd294c26e76">tempest-VolumesSnapshotTestJSON-1785106285</nova:project>
Aug 14 15:10:13 user nova-compute[73254]:       </nova:owner>
Aug 14 15:10:13 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:10:13 user nova-compute[73254]:       <nova:ports>
Aug 14 15:10:13 user nova-compute[73254]:         <nova:port uuid="fd7dd171-0b9c-474e-9f9f-15662377fdae">
Aug 14 15:10:13 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 15:10:13 user nova-compute[73254]:         </nova:port>
Aug 14 15:10:13 user nova-compute[73254]:       </nova:ports>
Aug 14 15:10:13 user nova-compute[73254]:     </nova:instance>
Aug 14 15:10:13 user nova-compute[73254]:   </metadata>
Aug 14 15:10:13 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:10:13 user nova-compute[73254]:     <system>
Aug 14 15:10:13 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:10:13 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:10:13 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:10:13 user nova-compute[73254]:       <entry name="serial">e1e2c36c-4583-4c4b-bc16-38b891a1be78</entry>
Aug 14 15:10:13 user nova-compute[73254]:       <entry name="uuid">e1e2c36c-4583-4c4b-bc16-38b891a1be78</entry>
Aug 14 15:10:13 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:10:13 user nova-compute[73254]:     </system>
Aug 14 15:10:13 user nova-compute[73254]:   </sysinfo>
Aug 14 15:10:13 user nova-compute[73254]:   <os>
Aug 14 15:10:13 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:10:13 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:10:13 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:10:13 user nova-compute[73254]:   </os>
Aug 14 15:10:13 user nova-compute[73254]:   <features>
Aug 14 15:10:13 user nova-compute[73254]:     <acpi/>
Aug 14 15:10:13 user nova-compute[73254]:     <apic/>
Aug 14 15:10:13 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:10:13 user nova-compute[73254]:   </features>
Aug 14 15:10:13 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:10:13 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:10:13 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:10:13 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:10:13 user nova-compute[73254]:   </clock>
Aug 14 15:10:13 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:10:13 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:10:13 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:10:13 user nova-compute[73254]:   </cpu>
Aug 14 15:10:13 user nova-compute[73254]:   <devices>
Aug 14 15:10:13 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:10:13 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:10:13 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk"/>
Aug 14 15:10:13 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:10:13 user nova-compute[73254]:     </disk>
Aug 14 15:10:13 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:10:13 user nova-compute[73254]:       <mac address="fa:16:3e:af:9d:8e"/>
Aug 14 15:10:13 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:10:13 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:10:13 user nova-compute[73254]:       <target dev="tapfd7dd171-0b"/>
Aug 14 15:10:13 user nova-compute[73254]:     </interface>
Aug 14 15:10:13 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:10:13 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/console.log" append="off"/>
Aug 14 15:10:13 user nova-compute[73254]:     </serial>
Aug 14 15:10:13 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:10:13 user nova-compute[73254]:     <video>
Aug 14 15:10:13 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:10:13 user nova-compute[73254]:     </video>
Aug 14 15:10:13 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:10:13 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:10:13 user nova-compute[73254]:     </rng>
Aug 14 15:10:13 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:10:13 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:10:13 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:10:13 user nova-compute[73254]:     </memballoon>
Aug 14 15:10:13 user nova-compute[73254]:   </devices>
Aug 14 15:10:13 user nova-compute[73254]: </domain>
Aug 14 15:10:13 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1314775822',display_name='tempest-VolumesSnapshotTestJSON-instance-1314775822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1314775822',id=31,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLb6YvHjwrNCwLKhT3FaZBVHLfLPSRf6jAH1DoViJryeY48WglvbVCCZ0C7WDmcg5aStfbcEc4a1/6LkjRjo0ssyVFHpqn3c5rINtHlNvEFNDb22jgnmItN6T9si/gdQ==',key_name='tempest-keypair-1269624836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d51019cbe3a4ce694c44fd294c26e76',ramdisk_id='',reservation_id='r-r070f7sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1785106285',owner_user_name='tempest-VolumesSnapshotTestJSON-1785106285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:10:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c372e49b3d04765aa35916ba8e2e0f8',uuid=e1e2c36c-4583-4c4b-bc16-38b891a1be78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converting VIF {"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:9d:8e,bridge_name='br-int',has_traffic_filtering=True,id=fd7dd171-0b9c-474e-9f9f-15662377fdae,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dd171-0b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG os_vif [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:9d:8e,bridge_name='br-int',has_traffic_filtering=True,id=fd7dd171-0b9c-474e-9f9f-15662377fdae,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dd171-0b') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd7dd171-0b, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd7dd171-0b, col_values=(('external_ids', {'iface-id': 'fd7dd171-0b9c-474e-9f9f-15662377fdae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:9d:8e', 'vm-uuid': 'e1e2c36c-4583-4c4b-bc16-38b891a1be78'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:13 user nova-compute[73254]: INFO os_vif [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:9d:8e,bridge_name='br-int',has_traffic_filtering=True,id=fd7dd171-0b9c-474e-9f9f-15662377fdae,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dd171-0b')
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] No VIF found with MAC fa:16:3e:af:9d:8e, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-d9022cb1-1740-409d-9b60-8a766251d422 req-c17c3cb9-d699-4a99-9a21-7e1c5883f61e service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Updated VIF entry in instance network info cache for port fd7dd171-0b9c-474e-9f9f-15662377fdae. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-d9022cb1-1740-409d-9b60-8a766251d422 req-c17c3cb9-d699-4a99-9a21-7e1c5883f61e service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Updating instance_info_cache with network_info: [{"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d9022cb1-1740-409d-9b60-8a766251d422 req-c17c3cb9-d699-4a99-9a21-7e1c5883f61e service nova] Releasing lock "refresh_cache-e1e2c36c-4583-4c4b-bc16-38b891a1be78" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG nova.objects.instance [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'flavor' on Instance uuid 456882f8-f70c-4a85-b593-c1066e732a9e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:10:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bc7c249e-a18b-4629-8a42-603b17b1c851 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.923s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-38c91e7c-80b6-4a7f-8da7-0b7d926f73ab req-4bd37fa7-b275-412c-8c41-875687d702fa service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received event network-vif-plugged-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:10:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-38c91e7c-80b6-4a7f-8da7-0b7d926f73ab req-4bd37fa7-b275-412c-8c41-875687d702fa service nova] Acquiring lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-38c91e7c-80b6-4a7f-8da7-0b7d926f73ab req-4bd37fa7-b275-412c-8c41-875687d702fa service nova] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-38c91e7c-80b6-4a7f-8da7-0b7d926f73ab req-4bd37fa7-b275-412c-8c41-875687d702fa service nova] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-38c91e7c-80b6-4a7f-8da7-0b7d926f73ab req-4bd37fa7-b275-412c-8c41-875687d702fa service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] No waiting events found dispatching network-vif-plugged-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:10:15 user nova-compute[73254]: WARNING nova.compute.manager [req-38c91e7c-80b6-4a7f-8da7-0b7d926f73ab req-4bd37fa7-b275-412c-8c41-875687d702fa service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received unexpected event network-vif-plugged-fd7dd171-0b9c-474e-9f9f-15662377fdae for instance with vm_state building and task_state spawning.
Aug 14 15:10:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025816.8756351, e1e2c36c-4583-4c4b-bc16-38b891a1be78 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:10:16 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] VM Resumed (Lifecycle Event)
Aug 14 15:10:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:10:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Instance spawned successfully.
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:10:16 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025816.8911574, e1e2c36c-4583-4c4b-bc16-38b891a1be78 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:10:16 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] VM Started (Lifecycle Event)
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:10:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:10:16 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:10:17 user nova-compute[73254]: INFO nova.compute.manager [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Took 6.51 seconds to spawn the instance on the hypervisor.
Aug 14 15:10:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:10:17 user nova-compute[73254]: INFO nova.compute.manager [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Took 7.42 seconds to build instance.
Aug 14 15:10:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dfdf0971-6fb2-407d-af45-5c3e01269c99 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.523s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-419dc199-107d-424c-bffa-9bb640a4994c req-d99709b4-cb9c-435c-9844-619d3cf4d54f service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received event network-vif-plugged-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:10:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-419dc199-107d-424c-bffa-9bb640a4994c req-d99709b4-cb9c-435c-9844-619d3cf4d54f service nova] Acquiring lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-419dc199-107d-424c-bffa-9bb640a4994c req-d99709b4-cb9c-435c-9844-619d3cf4d54f service nova] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-419dc199-107d-424c-bffa-9bb640a4994c req-d99709b4-cb9c-435c-9844-619d3cf4d54f service nova] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-419dc199-107d-424c-bffa-9bb640a4994c req-d99709b4-cb9c-435c-9844-619d3cf4d54f service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] No waiting events found dispatching network-vif-plugged-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:10:17 user nova-compute[73254]: WARNING nova.compute.manager [req-419dc199-107d-424c-bffa-9bb640a4994c req-d99709b4-cb9c-435c-9844-619d3cf4d54f service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received unexpected event network-vif-plugged-fd7dd171-0b9c-474e-9f9f-15662377fdae for instance with vm_state active and task_state None.
Aug 14 15:10:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-cc577b03-5fbb-4d75-a13d-99671ecd5053 req-68201ccb-95f8-4d58-94d6-b7a21919351c service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-changed-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:10:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-cc577b03-5fbb-4d75-a13d-99671ecd5053 req-68201ccb-95f8-4d58-94d6-b7a21919351c service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Refreshing instance network info cache due to event network-changed-2ec17370-cd59-4a47-ba00-ad12c2c4dc25. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:10:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cc577b03-5fbb-4d75-a13d-99671ecd5053 req-68201ccb-95f8-4d58-94d6-b7a21919351c service nova] Acquiring lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:10:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cc577b03-5fbb-4d75-a13d-99671ecd5053 req-68201ccb-95f8-4d58-94d6-b7a21919351c service nova] Acquired lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:10:48 user nova-compute[73254]: DEBUG nova.network.neutron [req-cc577b03-5fbb-4d75-a13d-99671ecd5053 req-68201ccb-95f8-4d58-94d6-b7a21919351c service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Refreshing network info cache for port 2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:10:48 user nova-compute[73254]: DEBUG nova.network.neutron [req-cc577b03-5fbb-4d75-a13d-99671ecd5053 req-68201ccb-95f8-4d58-94d6-b7a21919351c service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updated VIF entry in instance network info cache for port 2ec17370-cd59-4a47-ba00-ad12c2c4dc25. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:10:48 user nova-compute[73254]: DEBUG nova.network.neutron [req-cc577b03-5fbb-4d75-a13d-99671ecd5053 req-68201ccb-95f8-4d58-94d6-b7a21919351c service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updating instance_info_cache with network_info: [{"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:10:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cc577b03-5fbb-4d75-a13d-99671ecd5053 req-68201ccb-95f8-4d58-94d6-b7a21919351c service nova] Releasing lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:49 user nova-compute[73254]: INFO nova.compute.manager [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Detaching volume 9621ca7b-7842-476e-b1b4-34f1e83a484c
Aug 14 15:10:49 user nova-compute[73254]: INFO nova.virt.block_device [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Attempting to driver detach volume 9621ca7b-7842-476e-b1b4-34f1e83a484c from mountpoint /dev/vdb
Aug 14 15:10:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Attempting to detach device vdb from instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:10:49 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:10:49 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:10:49 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:10:49 user nova-compute[73254]:   <serial>9621ca7b-7842-476e-b1b4-34f1e83a484c</serial>
Aug 14 15:10:49 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:10:49 user nova-compute[73254]: </disk>
Aug 14 15:10:49 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:10:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Successfully detached device vdb from instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25 from the persistent domain config.
Aug 14 15:10:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:10:49 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:10:49 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:10:49 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:10:49 user nova-compute[73254]:   <serial>9621ca7b-7842-476e-b1b4-34f1e83a484c</serial>
Aug 14 15:10:49 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:10:49 user nova-compute[73254]: </disk>
Aug 14 15:10:49 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025849.87751, 35c77333-bc2c-429b-a65f-dd87ae2bfe25 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:10:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Successfully detached device vdb from instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25 from the live domain config.
Aug 14 15:10:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SFEKZUwJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:10:49 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:10:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fff5ee9-4f2a-409a-8b3c-9d98e5133484]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efd28f9-61de-4281-b0f7-006767722c15]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:10:49 user nova-compute[73254]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)
Aug 14 15:10:49 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:10:49 user nova-compute[73254]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c (non-flash)
Aug 14 15:10:49 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd668377c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c'): ({'sdd'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Removing single pathed devices sdd {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e62db2-cf19-43ce-bec9-70620645f637]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f27c95-2d4e-4c35-b84c-6e61a256f9f1]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Flushing IO for device /dev/sdd {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:10:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb198f7-02d3-47b2-b95e-ab60e7661a1c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f973687a-4251-44a4-b178-12fbf93aca9f]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[265e0ef1-3d79-47d9-ab99-d1236a598284]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[467afcbf-7ee2-43c2-bd5a-165b3caf6221]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c, portal: 172.16.0.220,3260]
Aug 14 15:10:50 user nova-compute[73254]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c, portal: 172.16.0.220,3260] successful.
Aug 14 15:10:50 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9621ca7b-7842-476e-b1b4-34f1e83a484c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff0a6dd-c16c-4ecf-9115-de2b24887efe]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] <== disconnect_volume: return (262ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-23f1ad16-181e-4dcb-a563-4560d158a7f7 req-48eda761-7ebf-495c-8322-c26de4d18957 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-changed-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-23f1ad16-181e-4dcb-a563-4560d158a7f7 req-48eda761-7ebf-495c-8322-c26de4d18957 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Refreshing instance network info cache due to event network-changed-2ec17370-cd59-4a47-ba00-ad12c2c4dc25. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-23f1ad16-181e-4dcb-a563-4560d158a7f7 req-48eda761-7ebf-495c-8322-c26de4d18957 service nova] Acquiring lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-23f1ad16-181e-4dcb-a563-4560d158a7f7 req-48eda761-7ebf-495c-8322-c26de4d18957 service nova] Acquired lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG nova.network.neutron [req-23f1ad16-181e-4dcb-a563-4560d158a7f7 req-48eda761-7ebf-495c-8322-c26de4d18957 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Refreshing network info cache for port 2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG nova.network.neutron [req-23f1ad16-181e-4dcb-a563-4560d158a7f7 req-48eda761-7ebf-495c-8322-c26de4d18957 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updated VIF entry in instance network info cache for port 2ec17370-cd59-4a47-ba00-ad12c2c4dc25. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG nova.network.neutron [req-23f1ad16-181e-4dcb-a563-4560d158a7f7 req-48eda761-7ebf-495c-8322-c26de4d18957 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updating instance_info_cache with network_info: [{"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:10:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-23f1ad16-181e-4dcb-a563-4560d158a7f7 req-48eda761-7ebf-495c-8322-c26de4d18957 service nova] Releasing lock "refresh_cache-35c77333-bc2c-429b-a65f-dd87ae2bfe25" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:10:51 user nova-compute[73254]: DEBUG nova.objects.instance [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'flavor' on Instance uuid 35c77333-bc2c-429b-a65f-dd87ae2bfe25 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:10:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-18432bcf-ce40-4811-8d75-3de53cead14c tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.724s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Acquiring lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Acquiring lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:54 user nova-compute[73254]: INFO nova.compute.manager [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Terminating instance
Aug 14 15:10:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-a34feedb-141e-41ed-bf62-d64892f1fd3c req-b5e6e3f3-c0bf-4156-8347-5f4c7010708d service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Received event network-vif-unplugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a34feedb-141e-41ed-bf62-d64892f1fd3c req-b5e6e3f3-c0bf-4156-8347-5f4c7010708d service nova] Acquiring lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a34feedb-141e-41ed-bf62-d64892f1fd3c req-b5e6e3f3-c0bf-4156-8347-5f4c7010708d service nova] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a34feedb-141e-41ed-bf62-d64892f1fd3c req-b5e6e3f3-c0bf-4156-8347-5f4c7010708d service nova] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-a34feedb-141e-41ed-bf62-d64892f1fd3c req-b5e6e3f3-c0bf-4156-8347-5f4c7010708d service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] No waiting events found dispatching network-vif-unplugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:10:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-a34feedb-141e-41ed-bf62-d64892f1fd3c req-b5e6e3f3-c0bf-4156-8347-5f4c7010708d service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Received event network-vif-unplugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:10:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Instance destroyed successfully.
Aug 14 15:10:55 user nova-compute[73254]: DEBUG nova.objects.instance [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lazy-loading 'resources' on Instance uuid a4fe3ea7-bf03-486f-8a84-fb4867a6fc52 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:08:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1141897973',display_name='tempest-VolumesActionsTest-instance-1141897973',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1141897973',id=28,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:09:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='774e0b54415c41ac8f99bcf51f64089f',ramdisk_id='',reservation_id='r-920e2fsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-801740308',owner_user_name='tempest-VolumesActionsTest-801740308-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:09:05Z,user_data=None,user_id='1cf23f294b5043eeaa3bd440c37b5bce',uuid=a4fe3ea7-bf03-486f-8a84-fb4867a6fc52,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "address": "fa:16:3e:dc:41:b8", "network": {"id": "87e72403-7fd3-4280-b101-4cad284af184", "bridge": "br-int", "label": "tempest-VolumesActionsTest-705162768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774e0b54415c41ac8f99bcf51f64089f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd574ca0a-56", "ovs_interfaceid": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Converting VIF {"id": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "address": "fa:16:3e:dc:41:b8", "network": {"id": "87e72403-7fd3-4280-b101-4cad284af184", "bridge": "br-int", "label": "tempest-VolumesActionsTest-705162768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774e0b54415c41ac8f99bcf51f64089f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd574ca0a-56", "ovs_interfaceid": "d574ca0a-56ea-4fc2-82d2-da0d3025adf0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:41:b8,bridge_name='br-int',has_traffic_filtering=True,id=d574ca0a-56ea-4fc2-82d2-da0d3025adf0,network=Network(87e72403-7fd3-4280-b101-4cad284af184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd574ca0a-56') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG os_vif [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:41:b8,bridge_name='br-int',has_traffic_filtering=True,id=d574ca0a-56ea-4fc2-82d2-da0d3025adf0,network=Network(87e72403-7fd3-4280-b101-4cad284af184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd574ca0a-56') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd574ca0a-56, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:10:55 user nova-compute[73254]: INFO os_vif [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:41:b8,bridge_name='br-int',has_traffic_filtering=True,id=d574ca0a-56ea-4fc2-82d2-da0d3025adf0,network=Network(87e72403-7fd3-4280-b101-4cad284af184),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd574ca0a-56')
Aug 14 15:10:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Deleting instance files /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52_del
Aug 14 15:10:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Deletion of /opt/stack/data/nova/instances/a4fe3ea7-bf03-486f-8a84-fb4867a6fc52_del complete
Aug 14 15:10:55 user nova-compute[73254]: INFO nova.compute.manager [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 14 15:10:55 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-e419fc79-dc54-4290-872e-807c61934c08 req-7d90991b-0d25-40bd-b5e7-d72094860bcc service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Received event network-vif-deleted-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:10:55 user nova-compute[73254]: INFO nova.compute.manager [req-e419fc79-dc54-4290-872e-807c61934c08 req-7d90991b-0d25-40bd-b5e7-d72094860bcc service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Neutron deleted interface d574ca0a-56ea-4fc2-82d2-da0d3025adf0; detaching it from the instance and deleting it from the info cache
Aug 14 15:10:55 user nova-compute[73254]: DEBUG nova.network.neutron [req-e419fc79-dc54-4290-872e-807c61934c08 req-7d90991b-0d25-40bd-b5e7-d72094860bcc service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:10:55 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Took 0.54 seconds to deallocate network for instance.
Aug 14 15:10:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-e419fc79-dc54-4290-872e-807c61934c08 req-7d90991b-0d25-40bd-b5e7-d72094860bcc service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Detach interface failed, port_id=d574ca0a-56ea-4fc2-82d2-da0d3025adf0, reason: Instance a4fe3ea7-bf03-486f-8a84-fb4867a6fc52 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:56 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:10:56 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:10:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:56 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Deleted allocations for instance a4fe3ea7-bf03-486f-8a84-fb4867a6fc52
Aug 14 15:10:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ea9ed5dc-79cf-499f-819b-2f3d2d1cbcdb tempest-VolumesActionsTest-801740308 tempest-VolumesActionsTest-801740308-project-member] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.830s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-fde43e98-9978-4124-9b05-bf81e9876574 req-cca497a1-f713-4df2-83ab-808701b31a43 service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Received event network-vif-plugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:10:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fde43e98-9978-4124-9b05-bf81e9876574 req-cca497a1-f713-4df2-83ab-808701b31a43 service nova] Acquiring lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:10:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fde43e98-9978-4124-9b05-bf81e9876574 req-cca497a1-f713-4df2-83ab-808701b31a43 service nova] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:10:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fde43e98-9978-4124-9b05-bf81e9876574 req-cca497a1-f713-4df2-83ab-808701b31a43 service nova] Lock "a4fe3ea7-bf03-486f-8a84-fb4867a6fc52-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:10:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-fde43e98-9978-4124-9b05-bf81e9876574 req-cca497a1-f713-4df2-83ab-808701b31a43 service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] No waiting events found dispatching network-vif-plugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:10:56 user nova-compute[73254]: WARNING nova.compute.manager [req-fde43e98-9978-4124-9b05-bf81e9876574 req-cca497a1-f713-4df2-83ab-808701b31a43 service nova] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Received unexpected event network-vif-plugged-d574ca0a-56ea-4fc2-82d2-da0d3025adf0 for instance with vm_state deleted and task_state None.
Aug 14 15:11:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-7ee1ed6a-a3b4-4e62-80ec-6b91178e0442 req-1a8fa487-d0d5-4aba-8ac3-26b5e62401ec service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-changed-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-7ee1ed6a-a3b4-4e62-80ec-6b91178e0442 req-1a8fa487-d0d5-4aba-8ac3-26b5e62401ec service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Refreshing instance network info cache due to event network-changed-30118178-a209-428b-a649-a9ebf6ef2b39. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7ee1ed6a-a3b4-4e62-80ec-6b91178e0442 req-1a8fa487-d0d5-4aba-8ac3-26b5e62401ec service nova] Acquiring lock "refresh_cache-99c570f9-25b2-4a7f-93b1-6669bc58cb97" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7ee1ed6a-a3b4-4e62-80ec-6b91178e0442 req-1a8fa487-d0d5-4aba-8ac3-26b5e62401ec service nova] Acquired lock "refresh_cache-99c570f9-25b2-4a7f-93b1-6669bc58cb97" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG nova.network.neutron [req-7ee1ed6a-a3b4-4e62-80ec-6b91178e0442 req-1a8fa487-d0d5-4aba-8ac3-26b5e62401ec service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Refreshing network info cache for port 30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG nova.network.neutron [req-7ee1ed6a-a3b4-4e62-80ec-6b91178e0442 req-1a8fa487-d0d5-4aba-8ac3-26b5e62401ec service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Updated VIF entry in instance network info cache for port 30118178-a209-428b-a649-a9ebf6ef2b39. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG nova.network.neutron [req-7ee1ed6a-a3b4-4e62-80ec-6b91178e0442 req-1a8fa487-d0d5-4aba-8ac3-26b5e62401ec service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Updating instance_info_cache with network_info: [{"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7ee1ed6a-a3b4-4e62-80ec-6b91178e0442 req-1a8fa487-d0d5-4aba-8ac3-26b5e62401ec service nova] Releasing lock "refresh_cache-99c570f9-25b2-4a7f-93b1-6669bc58cb97" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'flavor' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:01 user nova-compute[73254]: INFO nova.compute.manager [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Attaching volume b9073505-3a20-4398-8a64-3cbf36e4984f to /dev/vdb
Aug 14 15:11:01 user nova-compute[73254]: DEBUG os_brick.utils [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25a3683-553a-46cf-85b6-4488a8f29af7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfbde1b-4330-4b9b-9d5b-66df54d87a56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf33d69-1b3a-436b-8c59-04259508fd31]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c924a01-8eb8-4d85-bb0c-f5414ec32867]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:11:01 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:11:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0aa3cea-719f-4fbd-9186-e1f7031d12ad]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG os_brick.utils [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:11:01 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Updating existing volume attachment record: cc0c5ff7-b8c6-4369-adbd-a3628456e864 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:02 user nova-compute[73254]: INFO nova.compute.manager [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Terminating instance
Aug 14 15:11:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-1063ac23-7b0b-4618-80bf-46b8e7a1c30b req-a82e1998-5040-47d1-a7af-8ac2d7fe5652 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-vif-unplugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1063ac23-7b0b-4618-80bf-46b8e7a1c30b req-a82e1998-5040-47d1-a7af-8ac2d7fe5652 service nova] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1063ac23-7b0b-4618-80bf-46b8e7a1c30b req-a82e1998-5040-47d1-a7af-8ac2d7fe5652 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1063ac23-7b0b-4618-80bf-46b8e7a1c30b req-a82e1998-5040-47d1-a7af-8ac2d7fe5652 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-1063ac23-7b0b-4618-80bf-46b8e7a1c30b req-a82e1998-5040-47d1-a7af-8ac2d7fe5652 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] No waiting events found dispatching network-vif-unplugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-1063ac23-7b0b-4618-80bf-46b8e7a1c30b req-a82e1998-5040-47d1-a7af-8ac2d7fe5652 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-vif-unplugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Instance destroyed successfully.
Aug 14 15:11:03 user nova-compute[73254]: DEBUG nova.objects.instance [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'resources' on Instance uuid 456882f8-f70c-4a85-b593-c1066e732a9e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1719411706',display_name='tempest-AttachVolumeNegativeTest-server-1719411706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1719411706',id=21,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWi5E+Yw3b/LQ/GkHikNmQmhnVN0IZHSYacSlwaLjKqe7iuiyKWYZ/lO7OZeBfMM31MRFzQHzm9iLrKfN3vRimpcVkqkXDny502rGigSZnx41t9cxrIL2Fb6CRNyxAvBQ==',key_name='tempest-keypair-1022735574',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:05:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-pkluukai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:05:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=456882f8-f70c-4a85-b593-c1066e732a9e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "address": "fa:16:3e:7f:79:fc", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape963bea9-b6", "ovs_interfaceid": "e963bea9-b6dc-4cb1-be12-e5d5688d774e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=e963bea9-b6dc-4cb1-be12-e5d5688d774e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape963bea9-b6') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG os_vif [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=e963bea9-b6dc-4cb1-be12-e5d5688d774e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape963bea9-b6') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape963bea9-b6, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:03 user nova-compute[73254]: INFO os_vif [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:79:fc,bridge_name='br-int',has_traffic_filtering=True,id=e963bea9-b6dc-4cb1-be12-e5d5688d774e,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape963bea9-b6')
Aug 14 15:11:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Deleting instance files /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e_del
Aug 14 15:11:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Deletion of /opt/stack/data/nova/instances/456882f8-f70c-4a85-b593-c1066e732a9e_del complete
Aug 14 15:11:03 user nova-compute[73254]: INFO nova.compute.manager [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 14 15:11:03 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] No waiting events found dispatching network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:04 user nova-compute[73254]: WARNING nova.compute.manager [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received unexpected event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e for instance with vm_state active and task_state deleting.
Aug 14 15:11:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] No waiting events found dispatching network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:04 user nova-compute[73254]: WARNING nova.compute.manager [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received unexpected event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e for instance with vm_state active and task_state deleting.
Aug 14 15:11:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] No waiting events found dispatching network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:04 user nova-compute[73254]: WARNING nova.compute.manager [req-a307b305-b5e7-4085-be46-356f15dd708f req-62edba91-01fb-4628-98ff-ff95bbb761c2 service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received unexpected event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e for instance with vm_state active and task_state deleting.
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:05 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Took 2.36 seconds to deallocate network for instance.
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:06 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Deleted allocations for instance 456882f8-f70c-4a85-b593-c1066e732a9e
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:06 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Error from libvirt while getting description of instance-00000015: [Error Code 42] Domain not found: no domain with matching uuid '456882f8-f70c-4a85-b593-c1066e732a9e' (instance-00000015): libvirt.libvirtError: Domain not found: no domain with matching uuid '456882f8-f70c-4a85-b593-c1066e732a9e' (instance-00000015)
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-46f78025-f4ad-4819-8a42-86bb59056334 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "456882f8-f70c-4a85-b593-c1066e732a9e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.102s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-10ac8c28-3022-4375-aba4-643b6a03352a req-84c1a10f-8ceb-45d7-8da1-374da4840552 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-changed-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-10ac8c28-3022-4375-aba4-643b6a03352a req-84c1a10f-8ceb-45d7-8da1-374da4840552 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Refreshing instance network info cache due to event network-changed-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-10ac8c28-3022-4375-aba4-643b6a03352a req-84c1a10f-8ceb-45d7-8da1-374da4840552 service nova] Acquiring lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-10ac8c28-3022-4375-aba4-643b6a03352a req-84c1a10f-8ceb-45d7-8da1-374da4840552 service nova] Acquired lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-10ac8c28-3022-4375-aba4-643b6a03352a req-84c1a10f-8ceb-45d7-8da1-374da4840552 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Refreshing network info cache for port 0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-vif-unplugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] No waiting events found dispatching network-vif-unplugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:06 user nova-compute[73254]: WARNING nova.compute.manager [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received unexpected event network-vif-unplugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e for instance with vm_state deleted and task_state None.
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] Acquiring lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] Lock "456882f8-f70c-4a85-b593-c1066e732a9e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] No waiting events found dispatching network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:06 user nova-compute[73254]: WARNING nova.compute.manager [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received unexpected event network-vif-plugged-e963bea9-b6dc-4cb1-be12-e5d5688d774e for instance with vm_state deleted and task_state None.
Aug 14 15:11:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-0928dc06-eff3-44b4-a3de-175779a0c44b req-78bdfa50-15f4-44fd-9aeb-7eb2f08f6a8c service nova] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Received event network-vif-deleted-e963bea9-b6dc-4cb1-be12-e5d5688d774e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG nova.network.neutron [req-10ac8c28-3022-4375-aba4-643b6a03352a req-84c1a10f-8ceb-45d7-8da1-374da4840552 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updated VIF entry in instance network info cache for port 0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG nova.network.neutron [req-10ac8c28-3022-4375-aba4-643b6a03352a req-84c1a10f-8ceb-45d7-8da1-374da4840552 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updating instance_info_cache with network_info: [{"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-10ac8c28-3022-4375-aba4-643b6a03352a req-84c1a10f-8ceb-45d7-8da1-374da4840552 service nova] Releasing lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:07 user nova-compute[73254]: INFO nova.compute.manager [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] instance snapshotting
Aug 14 15:11:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:07 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Beginning live snapshot process
Aug 14 15:11:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:11:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7131MB free_disk=25.055824279785156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json -f qcow2 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a651971c-b3b5-490b-b09e-6f93be59c663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 01773c99-e739-4da9-8c0b-493556a46e2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e1e2c36c-4583-4c4b-bc16-38b891a1be78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json -f qcow2" returned: 0 in 0.184s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json -f qcow2 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json -f qcow2" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:11:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.559s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.198s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsl5t61c5/560785c7cb314358aec45a76575c1d34.delta 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpsl5t61c5/560785c7cb314358aec45a76575c1d34.delta 1073741824" returned: 0 in 0.050s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:09 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 15:11:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73254) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 15:11:10 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025855.153432, a4fe3ea7-bf03-486f-8a84-fb4867a6fc52 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:11:10 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] VM Stopped (Lifecycle Event)
Aug 14 15:11:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7bb96417-75d6-48f1-8783-11e35084c45c None None] [instance: a4fe3ea7-bf03-486f-8a84-fb4867a6fc52] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73254) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 15:11:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 15:11:10 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:11:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsl5t61c5/560785c7cb314358aec45a76575c1d34.delta /opt/stack/data/nova/instances/snapshots/tmpsl5t61c5/560785c7cb314358aec45a76575c1d34 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpsl5t61c5/560785c7cb314358aec45a76575c1d34.delta /opt/stack/data/nova/instances/snapshots/tmpsl5t61c5/560785c7cb314358aec45a76575c1d34" returned: 0 in 0.604s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Snapshot extracted, beginning image upload
Aug 14 15:11:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzCuAYMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:11:11 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:11:11 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:11:11 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9691c8d-fee9-41ac-a359-5542996f627a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:11:11 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c91197-3b20-40d5-a41f-6f4f32f11cd9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f] added
Aug 14 15:11:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4f3e61-5e11-43c2-86be-f86477fa85d1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d11c34-fbd0-4524-abf8-f18e2f7e7ae5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vzCuAYMy {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vzCuAYMy" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a41ac6-87bf-491e-b490-a0665074f1de]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vzCuAYMy'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[37150ad3-13ad-4e7e-b328-7bf76fd33e3a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fdeb9d-8cc3-4b39-bbc5-ed862aced7d4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[27459b0e-32a5-4b2e-a08d-b3b6cd9cb772]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260]
Aug 14 15:11:11 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260] successful.
Aug 14 15:11:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb1c8bb-1c35-4a16-b6b1-19eee2bdcac0]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e5b13f-a2b3-4b2e-8511-90e65dde83f8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:11 user nova-compute[73254]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:11:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:11 user nova-compute[73254]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:11:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bc8fdb-43aa-4393-a5c6-9b72cead3903]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:11:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzCuAYMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26261656362343866', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261656362343866', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'flavor' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:11:12 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:11:12 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:11:12 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:11:12 user nova-compute[73254]:   <serial>b9073505-3a20-4398-8a64-3cbf36e4984f</serial>
Aug 14 15:11:12 user nova-compute[73254]: </disk>
Aug 14 15:11:12 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No VIF found with MAC fa:16:3e:c6:04:a3, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:11:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a4467ae6-9e90-4099-bfa6-b592f2b4afe4 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.197s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Snapshot image upload complete
Aug 14 15:11:13 user nova-compute[73254]: INFO nova.compute.manager [None req-81b7cab2-fbef-4690-a3d0-39f51df3e978 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Took 5.91 seconds to snapshot the instance on the hypervisor.
Aug 14 15:11:14 user nova-compute[73254]: INFO nova.compute.manager [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Rebuilding instance
Aug 14 15:11:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'trusted_certs' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'pci_requests' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'pci_devices' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'resources' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'migration_context' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73254) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-2c397040-0e02-479e-a7ef-fb3812240b8d req-30f14ba1-e886-4be0-bb89-97d4f821374f service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-vif-unplugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2c397040-0e02-479e-a7ef-fb3812240b8d req-30f14ba1-e886-4be0-bb89-97d4f821374f service nova] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2c397040-0e02-479e-a7ef-fb3812240b8d req-30f14ba1-e886-4be0-bb89-97d4f821374f service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2c397040-0e02-479e-a7ef-fb3812240b8d req-30f14ba1-e886-4be0-bb89-97d4f821374f service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-2c397040-0e02-479e-a7ef-fb3812240b8d req-30f14ba1-e886-4be0-bb89-97d4f821374f service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] No waiting events found dispatching network-vif-unplugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:14 user nova-compute[73254]: WARNING nova.compute.manager [req-2c397040-0e02-479e-a7ef-fb3812240b8d req-30f14ba1-e886-4be0-bb89-97d4f821374f service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received unexpected event network-vif-unplugged-30118178-a209-428b-a649-a9ebf6ef2b39 for instance with vm_state active and task_state rebuilding.
Aug 14 15:11:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Instance destroyed successfully.
Aug 14 15:11:15 user nova-compute[73254]: INFO nova.compute.manager [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Detaching volume b9073505-3a20-4398-8a64-3cbf36e4984f
Aug 14 15:11:15 user nova-compute[73254]: INFO nova.virt.block_device [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Attempting to driver detach volume b9073505-3a20-4398-8a64-3cbf36e4984f from mountpoint /dev/vdb
Aug 14 15:11:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Attempting to detach device vdb from instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:11:15 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:11:15 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:11:15 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:11:15 user nova-compute[73254]:   <serial>b9073505-3a20-4398-8a64-3cbf36e4984f</serial>
Aug 14 15:11:15 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:11:15 user nova-compute[73254]: </disk>
Aug 14 15:11:15 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:11:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully detached device vdb from instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 from the persistent domain config.
Aug 14 15:11:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzCuAYMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:11:15 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1629889-908f-4d4a-9642-fa964aeb2c06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fb4068-b711-4083-afa0-ece9a5c7672d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:15 user nova-compute[73254]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:11:15 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:15 user nova-compute[73254]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:11:15 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64868a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b856ee3c-bf4a-4e5a-8ee3-9405688edcc5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd28c29-732a-42d6-bab0-648d5cdf8abd]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fdaec5-935f-452c-abd2-7d570209789d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e526101-475f-45c5-a798-3a44c78c8fcc]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b28534-24ec-4081-878f-f31b3bb7354f]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff09630-ebd7-4f52-bbaa-eb093fb9936a]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260]
Aug 14 15:11:15 user nova-compute[73254]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260] successful.
Aug 14 15:11:15 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab169d39-dced-4f57-a3d9-2e4c6959b9cf]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== disconnect_volume: return (257ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:11:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:11:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Instance destroyed successfully.
Aug 14 15:11:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-820172951',display_name='tempest-ServerActionsTestOtherA-server-1335560451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-820172951',id=29,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxweWbtJ3snXy8ZVLWJCwG56uXS2DyyqnyaiR5jWZGSkKXxPeOvERhjeuEaq12DhRmHFNgnz7fxy604iqewq01HbXKz2UIKeLGLTXTuDmGJW7zOnPqkKRm/I8wKCjvavg==',key_name='tempest-keypair-1364011075',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-fk0uij6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=99c570f9-25b2-4a7f-93b1-6669bc58cb97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_vif [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30118178-a2, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:16 user nova-compute[73254]: INFO os_vif [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2')
Aug 14 15:11:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzCuAYMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:11:16 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2795aa-249b-45ac-9095-3e5684a74a84]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d1520-303d-46b2-b350-ea2f0181f92e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:16 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:16 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648688550>, {}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Disconnecting from: [] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.047s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== disconnect_volume: return (47ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:11:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Deleting instance files /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97_del
Aug 14 15:11:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Deletion of /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97_del complete
Aug 14 15:11:16 user nova-compute[73254]: INFO nova.virt.block_device [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Booting with volume b9073505-3a20-4398-8a64-3cbf36e4984f at /dev/vdb
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.utils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ff6c40-62ec-41a4-b54f-ac007c629288]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-5491e80d-4611-4848-a8ce-b30c4b9251fc req-e8ddf42f-ff0a-49c5-be88-edbacbb3f0fc service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5491e80d-4611-4848-a8ce-b30c4b9251fc req-e8ddf42f-ff0a-49c5-be88-edbacbb3f0fc service nova] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5491e80d-4611-4848-a8ce-b30c4b9251fc req-e8ddf42f-ff0a-49c5-be88-edbacbb3f0fc service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5491e80d-4611-4848-a8ce-b30c4b9251fc req-e8ddf42f-ff0a-49c5-be88-edbacbb3f0fc service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-5491e80d-4611-4848-a8ce-b30c4b9251fc req-e8ddf42f-ff0a-49c5-be88-edbacbb3f0fc service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] No waiting events found dispatching network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:16 user nova-compute[73254]: WARNING nova.compute.manager [req-5491e80d-4611-4848-a8ce-b30c4b9251fc req-e8ddf42f-ff0a-49c5-be88-edbacbb3f0fc service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received unexpected event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84c91b8-6377-4ef8-9277-0989d2eafe53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa96c4cd-5648-4031-a6f4-69766a202a9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5549196b-d488-4977-8a47-817d3cae270d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:11:16 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:11:16 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7839fda-8900-4bf4-9eb5-43c6d33efa90]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG os_brick.utils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Updating existing volume attachment record: ded23925-2b2d-4651-a919-36b4a5879eb9 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:11:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:17 user nova-compute[73254]: INFO nova.compute.manager [None req-4621d3b1-9a53-4639-9279-1c359e895ee0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Unrescuing
Aug 14 15:11:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4621d3b1-9a53-4639-9279-1c359e895ee0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:11:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4621d3b1-9a53-4639-9279-1c359e895ee0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquired lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:11:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-4621d3b1-9a53-4639-9279-1c359e895ee0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:11:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-4621d3b1-9a53-4639-9279-1c359e895ee0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updating instance_info_cache with network_info: [{"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4621d3b1-9a53-4639-9279-1c359e895ee0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Releasing lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4621d3b1-9a53-4639-9279-1c359e895ee0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'flavor' on Instance uuid ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025863.0641723, 456882f8-f70c-4a85-b593-c1066e732a9e => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:11:18 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] VM Stopped (Lifecycle Event)
Aug 14 15:11:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5daf2412-286b-4fca-9825-79bb1db1bdb3 None None] [instance: 456882f8-f70c-4a85-b593-c1066e732a9e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-e1f86fb8-dc2c-4070-9068-c5bc3d4e1761 req-89d6acd6-291f-4971-9bdd-82a8becb41fe service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-unplugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1f86fb8-dc2c-4070-9068-c5bc3d4e1761 req-89d6acd6-291f-4971-9bdd-82a8becb41fe service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1f86fb8-dc2c-4070-9068-c5bc3d4e1761 req-89d6acd6-291f-4971-9bdd-82a8becb41fe service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1f86fb8-dc2c-4070-9068-c5bc3d4e1761 req-89d6acd6-291f-4971-9bdd-82a8becb41fe service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-e1f86fb8-dc2c-4070-9068-c5bc3d4e1761 req-89d6acd6-291f-4971-9bdd-82a8becb41fe service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-unplugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:18 user nova-compute[73254]: WARNING nova.compute.manager [req-e1f86fb8-dc2c-4070-9068-c5bc3d4e1761 req-89d6acd6-291f-4971-9bdd-82a8becb41fe service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-unplugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:11:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Instance destroyed successfully.
Aug 14 15:11:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01773c99-e739-4da9-8c0b-493556a46e2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:19 user nova-compute[73254]: INFO nova.compute.manager [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Terminating instance
Aug 14 15:11:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-cf39000d-e5fe-407f-b87d-c5f9b5c8c4ea req-c3a44d96-0186-4ab7-a9a6-f81ffedc2990 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-vif-unplugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cf39000d-e5fe-407f-b87d-c5f9b5c8c4ea req-c3a44d96-0186-4ab7-a9a6-f81ffedc2990 service nova] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cf39000d-e5fe-407f-b87d-c5f9b5c8c4ea req-c3a44d96-0186-4ab7-a9a6-f81ffedc2990 service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cf39000d-e5fe-407f-b87d-c5f9b5c8c4ea req-c3a44d96-0186-4ab7-a9a6-f81ffedc2990 service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-cf39000d-e5fe-407f-b87d-c5f9b5c8c4ea req-c3a44d96-0186-4ab7-a9a6-f81ffedc2990 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] No waiting events found dispatching network-vif-unplugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-cf39000d-e5fe-407f-b87d-c5f9b5c8c4ea req-c3a44d96-0186-4ab7-a9a6-f81ffedc2990 service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-vif-unplugged-7c5be923-e482-480c-881d-36637fb4d86c for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:20 user nova-compute[73254]: WARNING nova.compute.manager [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:11:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:20 user nova-compute[73254]: WARNING nova.compute.manager [req-322f5172-c0e4-4786-85c1-805c2fc6de93 req-6bd69f80-8848-4c08-bb04-d5dd5fbc3574 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:11:20 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Instance destroyed successfully.
Aug 14 15:11:20 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lazy-loading 'resources' on Instance uuid 01773c99-e739-4da9-8c0b-493556a46e2d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T15:05:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1981963554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1981963554',id=23,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORSMumc2z175KKxihxVqK5oLz7MtI9h0M1I9f6H36K99R6/T4QxMbFp3dDAEaOZsaRFaNu/Jq/XS2WT9vamTQxN78Bnq23SgKqo3YMAj5bIo7u2btB7GrvS9VpGXi9LZQ==',key_name='tempest-keypair-1788138174',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:09:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ac5a724189545548484fba6d4e0c842',ramdisk_id='',reservation_id='r-u0ndwxw3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-960640486',owner_user_name='tempest-AttachVolumeShelveTestJSON-960640486-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:09:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='abc1e49d76ae4690b8ab6b1dd5ec5eae',uuid=01773c99-e739-4da9-8c0b-493556a46e2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converting VIF {"id": "7c5be923-e482-480c-881d-36637fb4d86c", "address": "fa:16:3e:bc:6e:cb", "network": {"id": "2b9776e7-b85b-4c8b-a6cc-c796c6f64e74", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-475827372-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ac5a724189545548484fba6d4e0c842", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c5be923-e4", "ovs_interfaceid": "7c5be923-e482-480c-881d-36637fb4d86c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG os_vif [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c5be923-e4, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:11:20 user nova-compute[73254]: INFO os_vif [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:6e:cb,bridge_name='br-int',has_traffic_filtering=True,id=7c5be923-e482-480c-881d-36637fb4d86c,network=Network(2b9776e7-b85b-4c8b-a6cc-c796c6f64e74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c5be923-e4')
Aug 14 15:11:20 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Deleting instance files /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d_del
Aug 14 15:11:20 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Deletion of /opt/stack/data/nova/instances/01773c99-e739-4da9-8c0b-493556a46e2d_del complete
Aug 14 15:11:20 user nova-compute[73254]: INFO nova.compute.manager [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Took 1.35 seconds to destroy the instance on the hypervisor.
Aug 14 15:11:20 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:11:20 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:11:21 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:21 user nova-compute[73254]: DEBUG nova.compute.manager [req-5704fe3a-878d-45ad-b48a-29bb2408b0e4 req-292f307e-4a75-4991-9b7f-be876cf091ac service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5704fe3a-878d-45ad-b48a-29bb2408b0e4 req-292f307e-4a75-4991-9b7f-be876cf091ac service nova] Acquiring lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5704fe3a-878d-45ad-b48a-29bb2408b0e4 req-292f307e-4a75-4991-9b7f-be876cf091ac service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5704fe3a-878d-45ad-b48a-29bb2408b0e4 req-292f307e-4a75-4991-9b7f-be876cf091ac service nova] Lock "01773c99-e739-4da9-8c0b-493556a46e2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:21 user nova-compute[73254]: DEBUG nova.compute.manager [req-5704fe3a-878d-45ad-b48a-29bb2408b0e4 req-292f307e-4a75-4991-9b7f-be876cf091ac service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] No waiting events found dispatching network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:21 user nova-compute[73254]: WARNING nova.compute.manager [req-5704fe3a-878d-45ad-b48a-29bb2408b0e4 req-292f307e-4a75-4991-9b7f-be876cf091ac service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received unexpected event network-vif-plugged-7c5be923-e482-480c-881d-36637fb4d86c for instance with vm_state active and task_state deleting.
Aug 14 15:11:21 user nova-compute[73254]: DEBUG nova.compute.manager [req-5704fe3a-878d-45ad-b48a-29bb2408b0e4 req-292f307e-4a75-4991-9b7f-be876cf091ac service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Received event network-vif-deleted-7c5be923-e482-480c-881d-36637fb4d86c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:21 user nova-compute[73254]: INFO nova.compute.manager [req-5704fe3a-878d-45ad-b48a-29bb2408b0e4 req-292f307e-4a75-4991-9b7f-be876cf091ac service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Neutron deleted interface 7c5be923-e482-480c-881d-36637fb4d86c; detaching it from the instance and deleting it from the info cache
Aug 14 15:11:21 user nova-compute[73254]: DEBUG nova.network.neutron [req-5704fe3a-878d-45ad-b48a-29bb2408b0e4 req-292f307e-4a75-4991-9b7f-be876cf091ac service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:21 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Took 1.00 seconds to deallocate network for instance.
Aug 14 15:11:21 user nova-compute[73254]: DEBUG nova.compute.manager [req-5704fe3a-878d-45ad-b48a-29bb2408b0e4 req-292f307e-4a75-4991-9b7f-be876cf091ac service nova] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Detach interface failed, port_id=7c5be923-e482-480c-881d-36637fb4d86c, reason: Instance 01773c99-e739-4da9-8c0b-493556a46e2d could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:11:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:22 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Deleted allocations for instance 01773c99-e739-4da9-8c0b-493556a46e2d
Aug 14 15:11:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4e160b35-6440-4607-95f4-3ea3fbff045d tempest-AttachVolumeShelveTestJSON-960640486 tempest-AttachVolumeShelveTestJSON-960640486-project-member] Lock "01773c99-e739-4da9-8c0b-493556a46e2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.941s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-7460a7d7-cb1d-4df8-a25d-ba7e3b2d39ec req-599460f2-9987-4cf4-8616-175d28dda17e service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7460a7d7-cb1d-4df8-a25d-ba7e3b2d39ec req-599460f2-9987-4cf4-8616-175d28dda17e service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7460a7d7-cb1d-4df8-a25d-ba7e3b2d39ec req-599460f2-9987-4cf4-8616-175d28dda17e service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7460a7d7-cb1d-4df8-a25d-ba7e3b2d39ec req-599460f2-9987-4cf4-8616-175d28dda17e service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.compute.manager [req-7460a7d7-cb1d-4df8-a25d-ba7e3b2d39ec req-599460f2-9987-4cf4-8616-175d28dda17e service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:22 user nova-compute[73254]: WARNING nova.compute.manager [req-7460a7d7-cb1d-4df8-a25d-ba7e3b2d39ec req-599460f2-9987-4cf4-8616-175d28dda17e service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025882.6015213, ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:11:22 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] VM Resumed (Lifecycle Event)
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4621d3b1-9a53-4639-9279-1c359e895ee0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025882.603166, ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:11:22 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] VM Started (Lifecycle Event)
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:11:25 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:11:25 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Creating image(s)
Aug 14 15:11:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "/opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "/opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "/opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.217s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.205s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk 1073741824" returned: 0 in 0.124s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.337s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Cannot resize image /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Ensure instance console log exists: /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Start _get_guest_xml network_info=[{"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ded23925-2b2d-4651-a919-36b4a5879eb9', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzCuAYMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '99c570f9-25b2-4a7f-93b1-6669bc58cb97', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9073505-3a20-4398-8a64-3cbf36e4984f', 'serial': 'b9073505-3a20-4398-8a64-3cbf36e4984f'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:11:26 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 15:11:26 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'vcpu_model' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzCuAYMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:11:26 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:11:26 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:11:26 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fb545a-bd21-4802-8628-cbcf5567e83b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:11:26 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9787e54f-549e-4a27-99f9-2fe7a884327f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f] added
Aug 14 15:11:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e0f32b-add5-4ce6-b7c4-7862210566d3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9be937-b179-4a55-9205-d46a6b8e3b51]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vzCuAYMy {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vzCuAYMy" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[22792db3-6117-4759-9fb9-fd92e790355d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vzCuAYMy'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb3acea-4756-4ed1-88da-f5334577a957]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f93ea4-fca0-4661-b515-075f21362ff2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78afcfa-abd8-442b-a582-45fc2a8a5130]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260]
Aug 14 15:11:26 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260] successful.
Aug 14 15:11:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efcacda-b667-429f-ba6f-fbe1e2da6135]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ca98c1-05f0-4dde-99e5-b12d4cd0eeab]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:26 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:11:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:11:26 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:11:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cb31b3-4082-4167-bbed-c1fb29a1d6f3]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:11:26 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:11:27 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:11:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzCuAYMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:11:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:11:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26261656362343866', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:11:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261656362343866', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:11:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T15:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-820172951',display_name='tempest-ServerActionsTestOtherA-server-1335560451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-820172951',id=29,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxweWbtJ3snXy8ZVLWJCwG56uXS2DyyqnyaiR5jWZGSkKXxPeOvERhjeuEaq12DhRmHFNgnz7fxy604iqewq01HbXKz2UIKeLGLTXTuDmGJW7zOnPqkKRm/I8wKCjvavg==',key_name='tempest-keypair-1364011075',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-fk0uij6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=99c570f9-25b2-4a7f-93b1-6669bc58cb97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:11:27 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:11:27 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:11:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:11:27 user nova-compute[73254]:   <uuid>99c570f9-25b2-4a7f-93b1-6669bc58cb97</uuid>
Aug 14 15:11:27 user nova-compute[73254]:   <name>instance-0000001d</name>
Aug 14 15:11:27 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:11:27 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:11:27 user nova-compute[73254]:   <metadata>
Aug 14 15:11:27 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:11:27 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:11:27 user nova-compute[73254]:       <nova:name>tempest-ServerActionsTestOtherA-server-1335560451</nova:name>
Aug 14 15:11:27 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:11:26</nova:creationTime>
Aug 14 15:11:27 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:11:27 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:11:27 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:11:27 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:11:27 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:11:27 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:11:27 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:11:27 user nova-compute[73254]:       <nova:owner>
Aug 14 15:11:27 user nova-compute[73254]:         <nova:user uuid="e56bbc03d7af4dec928da4d490af7b76">tempest-ServerActionsTestOtherA-1005131430-project-member</nova:user>
Aug 14 15:11:27 user nova-compute[73254]:         <nova:project uuid="8a7dd480b32e4059b4d265a6049963e4">tempest-ServerActionsTestOtherA-1005131430</nova:project>
Aug 14 15:11:27 user nova-compute[73254]:       </nova:owner>
Aug 14 15:11:27 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:11:27 user nova-compute[73254]:       <nova:ports>
Aug 14 15:11:27 user nova-compute[73254]:         <nova:port uuid="30118178-a209-428b-a649-a9ebf6ef2b39">
Aug 14 15:11:27 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 15:11:27 user nova-compute[73254]:         </nova:port>
Aug 14 15:11:27 user nova-compute[73254]:       </nova:ports>
Aug 14 15:11:27 user nova-compute[73254]:     </nova:instance>
Aug 14 15:11:27 user nova-compute[73254]:   </metadata>
Aug 14 15:11:27 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:11:27 user nova-compute[73254]:     <system>
Aug 14 15:11:27 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:11:27 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:11:27 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:11:27 user nova-compute[73254]:       <entry name="serial">99c570f9-25b2-4a7f-93b1-6669bc58cb97</entry>
Aug 14 15:11:27 user nova-compute[73254]:       <entry name="uuid">99c570f9-25b2-4a7f-93b1-6669bc58cb97</entry>
Aug 14 15:11:27 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:11:27 user nova-compute[73254]:     </system>
Aug 14 15:11:27 user nova-compute[73254]:   </sysinfo>
Aug 14 15:11:27 user nova-compute[73254]:   <os>
Aug 14 15:11:27 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:11:27 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:11:27 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:11:27 user nova-compute[73254]:   </os>
Aug 14 15:11:27 user nova-compute[73254]:   <features>
Aug 14 15:11:27 user nova-compute[73254]:     <acpi/>
Aug 14 15:11:27 user nova-compute[73254]:     <apic/>
Aug 14 15:11:27 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:11:27 user nova-compute[73254]:   </features>
Aug 14 15:11:27 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:11:27 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:11:27 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:11:27 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:11:27 user nova-compute[73254]:   </clock>
Aug 14 15:11:27 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:11:27 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:11:27 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:11:27 user nova-compute[73254]:   </cpu>
Aug 14 15:11:27 user nova-compute[73254]:   <devices>
Aug 14 15:11:27 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:11:27 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:11:27 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk"/>
Aug 14 15:11:27 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:11:27 user nova-compute[73254]:     </disk>
Aug 14 15:11:27 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:11:27 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:11:27 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 15:11:27 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:11:27 user nova-compute[73254]:       <serial>b9073505-3a20-4398-8a64-3cbf36e4984f</serial>
Aug 14 15:11:27 user nova-compute[73254]:     </disk>
Aug 14 15:11:27 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:11:27 user nova-compute[73254]:       <mac address="fa:16:3e:c6:04:a3"/>
Aug 14 15:11:27 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:11:27 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:11:27 user nova-compute[73254]:       <target dev="tap30118178-a2"/>
Aug 14 15:11:27 user nova-compute[73254]:     </interface>
Aug 14 15:11:27 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:11:27 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/console.log" append="off"/>
Aug 14 15:11:27 user nova-compute[73254]:     </serial>
Aug 14 15:11:27 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:11:27 user nova-compute[73254]:     <video>
Aug 14 15:11:27 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:11:27 user nova-compute[73254]:     </video>
Aug 14 15:11:27 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:11:27 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:11:27 user nova-compute[73254]:     </rng>
Aug 14 15:11:27 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:11:27 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:11:27 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:11:27 user nova-compute[73254]:     </memballoon>
Aug 14 15:11:27 user nova-compute[73254]:   </devices>
Aug 14 15:11:27 user nova-compute[73254]: </domain>
Aug 14 15:11:27 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T15:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-820172951',display_name='tempest-ServerActionsTestOtherA-server-1335560451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-820172951',id=29,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxweWbtJ3snXy8ZVLWJCwG56uXS2DyyqnyaiR5jWZGSkKXxPeOvERhjeuEaq12DhRmHFNgnz7fxy604iqewq01HbXKz2UIKeLGLTXTuDmGJW7zOnPqkKRm/I8wKCjvavg==',key_name='tempest-keypair-1364011075',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-fk0uij6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:11:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=99c570f9-25b2-4a7f-93b1-6669bc58cb97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG os_vif [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30118178-a2, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30118178-a2, col_values=(('external_ids', {'iface-id': '30118178-a209-428b-a649-a9ebf6ef2b39', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:04:a3', 'vm-uuid': '99c570f9-25b2-4a7f-93b1-6669bc58cb97'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:28 user nova-compute[73254]: INFO os_vif [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2')
Aug 14 15:11:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No VIF found with MAC fa:16:3e:c6:04:a3, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:28 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:11:29 user nova-compute[73254]: INFO nova.compute.claims [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Claim successful on node user
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:11:29 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.policy [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5200b421cc6c4e45b91f547888fb896a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '977830faf2af42dd8be28808611d8d16', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:11:29 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Creating image(s)
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-cf6136e4-d44a-496e-a808-b24d49abc913 req-696f1f05-7de0-4b31-a790-e7deb36b2a39 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cf6136e4-d44a-496e-a808-b24d49abc913 req-696f1f05-7de0-4b31-a790-e7deb36b2a39 service nova] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cf6136e4-d44a-496e-a808-b24d49abc913 req-696f1f05-7de0-4b31-a790-e7deb36b2a39 service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cf6136e4-d44a-496e-a808-b24d49abc913 req-696f1f05-7de0-4b31-a790-e7deb36b2a39 service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-cf6136e4-d44a-496e-a808-b24d49abc913 req-696f1f05-7de0-4b31-a790-e7deb36b2a39 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] No waiting events found dispatching network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:29 user nova-compute[73254]: WARNING nova.compute.manager [req-cf6136e4-d44a-496e-a808-b24d49abc913 req-696f1f05-7de0-4b31-a790-e7deb36b2a39 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received unexpected event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 for instance with vm_state active and task_state rebuild_spawning.
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk 1073741824" returned: 0 in 0.217s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.417s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025875.23358, 99c570f9-25b2-4a7f-93b1-6669bc58cb97 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:11:30 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] VM Stopped (Lifecycle Event)
Aug 14 15:11:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d9896137-be86-4174-b476-3ef8688e4af1 None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.198s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Successfully created port: 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Cannot resize image /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'migration_context' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Ensure instance console log exists: /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Successfully updated port: 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquired lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025891.5987659, 99c570f9-25b2-4a7f-93b1-6669bc58cb97 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:11:31 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] VM Resumed (Lifecycle Event)
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:11:31 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Instance spawned successfully.
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:31 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025891.5993204, 99c570f9-25b2-4a7f-93b1-6669bc58cb97 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:11:31 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] VM Started (Lifecycle Event)
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:11:31 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73254) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0452c34d-f442-41ec-bed8-c70f58c871db tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.069s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.compute.manager [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.compute.manager [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] No waiting events found dispatching network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:32 user nova-compute[73254]: WARNING nova.compute.manager [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received unexpected event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 for instance with vm_state active and task_state None.
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.compute.manager [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-changed-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.compute.manager [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Refreshing instance network info cache due to event network-changed-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] Acquiring lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating instance_info_cache with network_info: [{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Releasing lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Instance network_info: |[{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] Acquired lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.network.neutron [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Refreshing network info cache for port 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Start _get_guest_xml network_info=[{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:11:32 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:11:32 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1127561786',display_name='tempest-ServerRescueNegativeTestJSON-server-1127561786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1127561786',id=32,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ01/enepWJq3H3SausIfGJeo9LJ/hhZa7U3U1wVIQCfY1rxWTtqM3d/PbPlfrZ1LO6IxUwIFKF3OZDo8ZPQjPuy+785ttYLlFxHYREQN/0eurbTclXoLGCA9t9pZC0nw==',key_name='tempest-keypair-1666366664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-gc5pb6d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5200b421cc6c4e45b91f547888fb896a',uuid=ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a6:b7,bridge_name='br-int',has_traffic_filtering=True,id=94e5c6ae-a805-4ec4-b673-11aafe7f9c8d,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e5c6ae-a8') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'pci_devices' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:11:32 user nova-compute[73254]:   <uuid>ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e</uuid>
Aug 14 15:11:32 user nova-compute[73254]:   <name>instance-00000020</name>
Aug 14 15:11:32 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:11:32 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:11:32 user nova-compute[73254]:   <metadata>
Aug 14 15:11:32 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:11:32 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:11:32 user nova-compute[73254]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1127561786</nova:name>
Aug 14 15:11:32 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:11:32</nova:creationTime>
Aug 14 15:11:32 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:11:32 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:11:32 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:11:32 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:11:32 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:11:32 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:11:32 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:11:32 user nova-compute[73254]:       <nova:owner>
Aug 14 15:11:32 user nova-compute[73254]:         <nova:user uuid="5200b421cc6c4e45b91f547888fb896a">tempest-ServerRescueNegativeTestJSON-324663021-project-member</nova:user>
Aug 14 15:11:32 user nova-compute[73254]:         <nova:project uuid="977830faf2af42dd8be28808611d8d16">tempest-ServerRescueNegativeTestJSON-324663021</nova:project>
Aug 14 15:11:32 user nova-compute[73254]:       </nova:owner>
Aug 14 15:11:32 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:11:32 user nova-compute[73254]:       <nova:ports>
Aug 14 15:11:32 user nova-compute[73254]:         <nova:port uuid="94e5c6ae-a805-4ec4-b673-11aafe7f9c8d">
Aug 14 15:11:32 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 15:11:32 user nova-compute[73254]:         </nova:port>
Aug 14 15:11:32 user nova-compute[73254]:       </nova:ports>
Aug 14 15:11:32 user nova-compute[73254]:     </nova:instance>
Aug 14 15:11:32 user nova-compute[73254]:   </metadata>
Aug 14 15:11:32 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:11:32 user nova-compute[73254]:     <system>
Aug 14 15:11:32 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:11:32 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:11:32 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:11:32 user nova-compute[73254]:       <entry name="serial">ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e</entry>
Aug 14 15:11:32 user nova-compute[73254]:       <entry name="uuid">ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e</entry>
Aug 14 15:11:32 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:11:32 user nova-compute[73254]:     </system>
Aug 14 15:11:32 user nova-compute[73254]:   </sysinfo>
Aug 14 15:11:32 user nova-compute[73254]:   <os>
Aug 14 15:11:32 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:11:32 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:11:32 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:11:32 user nova-compute[73254]:   </os>
Aug 14 15:11:32 user nova-compute[73254]:   <features>
Aug 14 15:11:32 user nova-compute[73254]:     <acpi/>
Aug 14 15:11:32 user nova-compute[73254]:     <apic/>
Aug 14 15:11:32 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:11:32 user nova-compute[73254]:   </features>
Aug 14 15:11:32 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:11:32 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:11:32 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:11:32 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:11:32 user nova-compute[73254]:   </clock>
Aug 14 15:11:32 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:11:32 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:11:32 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:11:32 user nova-compute[73254]:   </cpu>
Aug 14 15:11:32 user nova-compute[73254]:   <devices>
Aug 14 15:11:32 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:11:32 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:11:32 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk"/>
Aug 14 15:11:32 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:11:32 user nova-compute[73254]:     </disk>
Aug 14 15:11:32 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:11:32 user nova-compute[73254]:       <mac address="fa:16:3e:2e:a6:b7"/>
Aug 14 15:11:32 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:11:32 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:11:32 user nova-compute[73254]:       <target dev="tap94e5c6ae-a8"/>
Aug 14 15:11:32 user nova-compute[73254]:     </interface>
Aug 14 15:11:32 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:11:32 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/console.log" append="off"/>
Aug 14 15:11:32 user nova-compute[73254]:     </serial>
Aug 14 15:11:32 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:11:32 user nova-compute[73254]:     <video>
Aug 14 15:11:32 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:11:32 user nova-compute[73254]:     </video>
Aug 14 15:11:32 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:11:32 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:11:32 user nova-compute[73254]:     </rng>
Aug 14 15:11:32 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:11:32 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:11:32 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:11:32 user nova-compute[73254]:     </memballoon>
Aug 14 15:11:32 user nova-compute[73254]:   </devices>
Aug 14 15:11:32 user nova-compute[73254]: </domain>
Aug 14 15:11:32 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1127561786',display_name='tempest-ServerRescueNegativeTestJSON-server-1127561786',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1127561786',id=32,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ01/enepWJq3H3SausIfGJeo9LJ/hhZa7U3U1wVIQCfY1rxWTtqM3d/PbPlfrZ1LO6IxUwIFKF3OZDo8ZPQjPuy+785ttYLlFxHYREQN/0eurbTclXoLGCA9t9pZC0nw==',key_name='tempest-keypair-1666366664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-gc5pb6d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:11:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5200b421cc6c4e45b91f547888fb896a',uuid=ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a6:b7,bridge_name='br-int',has_traffic_filtering=True,id=94e5c6ae-a805-4ec4-b673-11aafe7f9c8d,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e5c6ae-a8') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG os_vif [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a6:b7,bridge_name='br-int',has_traffic_filtering=True,id=94e5c6ae-a805-4ec4-b673-11aafe7f9c8d,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e5c6ae-a8') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap94e5c6ae-a8, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap94e5c6ae-a8, col_values=(('external_ids', {'iface-id': '94e5c6ae-a805-4ec4-b673-11aafe7f9c8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:a6:b7', 'vm-uuid': 'ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:32 user nova-compute[73254]: INFO os_vif [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:a6:b7,bridge_name='br-int',has_traffic_filtering=True,id=94e5c6ae-a805-4ec4-b673-11aafe7f9c8d,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e5c6ae-a8')
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No VIF found with MAC fa:16:3e:2e:a6:b7, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.network.neutron [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updated VIF entry in instance network info cache for port 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG nova.network.neutron [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating instance_info_cache with network_info: [{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5e6d1ec6-2478-456d-b269-0c099b480aa3 req-2eadfc04-ffae-4f50-9d95-755e9087bf19 service nova] Releasing lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:11:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-16fb2ad9-8b09-4668-8065-8f77652f4b9f req-14297326-8eb2-4f4d-b230-4a076e851e27 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16fb2ad9-8b09-4668-8065-8f77652f4b9f req-14297326-8eb2-4f4d-b230-4a076e851e27 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16fb2ad9-8b09-4668-8065-8f77652f4b9f req-14297326-8eb2-4f4d-b230-4a076e851e27 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16fb2ad9-8b09-4668-8065-8f77652f4b9f req-14297326-8eb2-4f4d-b230-4a076e851e27 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-16fb2ad9-8b09-4668-8065-8f77652f4b9f req-14297326-8eb2-4f4d-b230-4a076e851e27 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:34 user nova-compute[73254]: WARNING nova.compute.manager [req-16fb2ad9-8b09-4668-8065-8f77652f4b9f req-14297326-8eb2-4f4d-b230-4a076e851e27 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state building and task_state spawning.
Aug 14 15:11:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:35 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025880.6579463, 01773c99-e739-4da9-8c0b-493556a46e2d => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:11:35 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] VM Stopped (Lifecycle Event)
Aug 14 15:11:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a12c03fb-fefd-4b84-aa18-866b74dc891c None None] [instance: 01773c99-e739-4da9-8c0b-493556a46e2d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:35 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025895.9846146, ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:11:35 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] VM Resumed (Lifecycle Event)
Aug 14 15:11:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:11:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:11:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Instance spawned successfully.
Aug 14 15:11:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:11:36 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025895.9886222, ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:11:36 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] VM Started (Lifecycle Event)
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-adc9f4e5-9b32-4680-8a31-65e925889166 req-be17bcb7-fbc6-454c-bae1-3c50b9e9dcf1 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-adc9f4e5-9b32-4680-8a31-65e925889166 req-be17bcb7-fbc6-454c-bae1-3c50b9e9dcf1 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-adc9f4e5-9b32-4680-8a31-65e925889166 req-be17bcb7-fbc6-454c-bae1-3c50b9e9dcf1 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-adc9f4e5-9b32-4680-8a31-65e925889166 req-be17bcb7-fbc6-454c-bae1-3c50b9e9dcf1 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-adc9f4e5-9b32-4680-8a31-65e925889166 req-be17bcb7-fbc6-454c-bae1-3c50b9e9dcf1 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:36 user nova-compute[73254]: WARNING nova.compute.manager [req-adc9f4e5-9b32-4680-8a31-65e925889166 req-be17bcb7-fbc6-454c-bae1-3c50b9e9dcf1 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state building and task_state spawning.
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:11:36 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:11:36 user nova-compute[73254]: INFO nova.compute.manager [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 14 15:11:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:11:36 user nova-compute[73254]: INFO nova.compute.manager [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Took 7.22 seconds to build instance.
Aug 14 15:11:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f92f133f-dfc1-4962-8847-cbd5a36d43e7 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.336s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:45 user nova-compute[73254]: INFO nova.compute.manager [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Terminating instance
Aug 14 15:11:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-0baddd81-ca42-430b-b0e9-7da0e67c53a0 req-fdaa2bf7-6052-478a-ad92-f5358ba64363 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-vif-unplugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0baddd81-ca42-430b-b0e9-7da0e67c53a0 req-fdaa2bf7-6052-478a-ad92-f5358ba64363 service nova] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0baddd81-ca42-430b-b0e9-7da0e67c53a0 req-fdaa2bf7-6052-478a-ad92-f5358ba64363 service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0baddd81-ca42-430b-b0e9-7da0e67c53a0 req-fdaa2bf7-6052-478a-ad92-f5358ba64363 service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-0baddd81-ca42-430b-b0e9-7da0e67c53a0 req-fdaa2bf7-6052-478a-ad92-f5358ba64363 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] No waiting events found dispatching network-vif-unplugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-0baddd81-ca42-430b-b0e9-7da0e67c53a0 req-fdaa2bf7-6052-478a-ad92-f5358ba64363 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-vif-unplugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:11:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Instance destroyed successfully.
Aug 14 15:11:45 user nova-compute[73254]: DEBUG nova.objects.instance [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lazy-loading 'resources' on Instance uuid 35c77333-bc2c-429b-a65f-dd87ae2bfe25 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:06:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2094262818',display_name='tempest-TestMinimumBasicScenario-server-2094262818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2094262818',id=25,image_ref='05987b15-e599-4a59-86d2-2b01be76728c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6s1as0uqOq9fN8AX4w1eK6nn4PyYEQB3qKjMqpWeSQlKKNONVC9oU0QkMZNzfCqtsjbMJK2lQOqLvuXEbwQcquiV/XY7Kp6pxHL9VA4jjLZoVrPLwgJXjzxMzdH85oRg==',key_name='tempest-TestMinimumBasicScenario-152339947',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:06:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='038244b91aad403897eb49752db371e7',ramdisk_id='',reservation_id='r-2uhhej6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='05987b15-e599-4a59-86d2-2b01be76728c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-270556114',owner_user_name='tempest-TestMinimumBasicScenario-270556114-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:09:05Z,user_data=None,user_id='55b05671f1cb4c05a7bedb3559968162',uuid=35c77333-bc2c-429b-a65f-dd87ae2bfe25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converting VIF {"id": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "address": "fa:16:3e:43:39:12", "network": {"id": "b5ceba65-6b71-4376-a0b7-0de70110a3c3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-853525630-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "038244b91aad403897eb49752db371e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec17370-cd", "ovs_interfaceid": "2ec17370-cd59-4a47-ba00-ad12c2c4dc25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:39:12,bridge_name='br-int',has_traffic_filtering=True,id=2ec17370-cd59-4a47-ba00-ad12c2c4dc25,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec17370-cd') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG os_vif [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:39:12,bridge_name='br-int',has_traffic_filtering=True,id=2ec17370-cd59-4a47-ba00-ad12c2c4dc25,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec17370-cd') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ec17370-cd, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:11:45 user nova-compute[73254]: INFO os_vif [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:39:12,bridge_name='br-int',has_traffic_filtering=True,id=2ec17370-cd59-4a47-ba00-ad12c2c4dc25,network=Network(b5ceba65-6b71-4376-a0b7-0de70110a3c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec17370-cd')
Aug 14 15:11:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Deleting instance files /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25_del
Aug 14 15:11:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Deletion of /opt/stack/data/nova/instances/35c77333-bc2c-429b-a65f-dd87ae2bfe25_del complete
Aug 14 15:11:46 user nova-compute[73254]: INFO nova.compute.manager [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 15:11:46 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:11:46 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:11:46 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:11:46 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:46 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Took 0.82 seconds to deallocate network for instance.
Aug 14 15:11:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-f782ea84-f595-49cf-abd1-b6add7ecdd94 req-79f6ff67-6a5a-4cfd-a906-1c562743066a service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-vif-deleted-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:47 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:11:47 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:11:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:47 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Deleted allocations for instance 35c77333-bc2c-429b-a65f-dd87ae2bfe25
Aug 14 15:11:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-75842bd3-44d8-425a-b5f0-4144de6f7286 tempest-TestMinimumBasicScenario-270556114 tempest-TestMinimumBasicScenario-270556114-project-member] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.260s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-79675e06-878b-4ea4-952b-6a576047c6d5 req-0cb9ab1d-7174-483e-bf9b-16cac72b3268 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-79675e06-878b-4ea4-952b-6a576047c6d5 req-0cb9ab1d-7174-483e-bf9b-16cac72b3268 service nova] Acquiring lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-79675e06-878b-4ea4-952b-6a576047c6d5 req-0cb9ab1d-7174-483e-bf9b-16cac72b3268 service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-79675e06-878b-4ea4-952b-6a576047c6d5 req-0cb9ab1d-7174-483e-bf9b-16cac72b3268 service nova] Lock "35c77333-bc2c-429b-a65f-dd87ae2bfe25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-79675e06-878b-4ea4-952b-6a576047c6d5 req-0cb9ab1d-7174-483e-bf9b-16cac72b3268 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] No waiting events found dispatching network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:11:47 user nova-compute[73254]: WARNING nova.compute.manager [req-79675e06-878b-4ea4-952b-6a576047c6d5 req-0cb9ab1d-7174-483e-bf9b-16cac72b3268 service nova] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Received unexpected event network-vif-plugged-2ec17370-cd59-4a47-ba00-ad12c2c4dc25 for instance with vm_state deleted and task_state None.
Aug 14 15:11:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:11:56 user nova-compute[73254]: INFO nova.compute.claims [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Claim successful on node user
Aug 14 15:11:56 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:11:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:11:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG nova.policy [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec4cf769cd15416bbbc1b9def6d12202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f209fa7e3ab40a2b5b9dc6725195d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:11:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:11:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Creating image(s)
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "/opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "/opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk 1073741824" returned: 0 in 0.056s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Successfully created port: 88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.200s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Cannot resize image /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG nova.objects.instance [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'migration_context' on Instance uuid 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Ensure instance console log exists: /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:11:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Successfully updated port: 88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "refresh_cache-0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquired lock "refresh_cache-0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-bbbb3bb6-6565-431b-ba03-c821e05e047e req-48fd3642-2b32-4330-bd63-9ffdc2a889fe service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received event network-changed-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-bbbb3bb6-6565-431b-ba03-c821e05e047e req-48fd3642-2b32-4330-bd63-9ffdc2a889fe service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Refreshing instance network info cache due to event network-changed-88db0d3f-4498-4bdf-97ef-d1a510af6302. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bbbb3bb6-6565-431b-ba03-c821e05e047e req-48fd3642-2b32-4330-bd63-9ffdc2a889fe service nova] Acquiring lock "refresh_cache-0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Updating instance_info_cache with network_info: [{"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Releasing lock "refresh_cache-0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Instance network_info: |[{"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bbbb3bb6-6565-431b-ba03-c821e05e047e req-48fd3642-2b32-4330-bd63-9ffdc2a889fe service nova] Acquired lock "refresh_cache-0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.network.neutron [req-bbbb3bb6-6565-431b-ba03-c821e05e047e req-48fd3642-2b32-4330-bd63-9ffdc2a889fe service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Refreshing network info cache for port 88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Start _get_guest_xml network_info=[{"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:11:58 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:11:58 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-934313066',display_name='tempest-AttachVolumeNegativeTest-server-934313066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-934313066',id=33,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzh3uLdNezMQtvFvj1h98LABWVOVjNut4JKzobdKWwo4TTLKAsgtYnYekSoLFAVVCIRUaLvon8+fzWkqpXqu7InOnGw6A8gfhdOypPCs4Rs24209rJ82JVT3jzwsTajlQ==',key_name='tempest-keypair-314522417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-905k87r2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=0fe8688c-4e52-4105-8b7b-9c59d2b66cf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:25:75,bridge_name='br-int',has_traffic_filtering=True,id=88db0d3f-4498-4bdf-97ef-d1a510af6302,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db0d3f-44') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:11:58 user nova-compute[73254]:   <uuid>0fe8688c-4e52-4105-8b7b-9c59d2b66cf8</uuid>
Aug 14 15:11:58 user nova-compute[73254]:   <name>instance-00000021</name>
Aug 14 15:11:58 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:11:58 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:11:58 user nova-compute[73254]:   <metadata>
Aug 14 15:11:58 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:11:58 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:11:58 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeNegativeTest-server-934313066</nova:name>
Aug 14 15:11:58 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:11:58</nova:creationTime>
Aug 14 15:11:58 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:11:58 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:11:58 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:11:58 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:11:58 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:11:58 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:11:58 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:11:58 user nova-compute[73254]:       <nova:owner>
Aug 14 15:11:58 user nova-compute[73254]:         <nova:user uuid="ec4cf769cd15416bbbc1b9def6d12202">tempest-AttachVolumeNegativeTest-476210608-project-member</nova:user>
Aug 14 15:11:58 user nova-compute[73254]:         <nova:project uuid="8f209fa7e3ab40a2b5b9dc6725195d22">tempest-AttachVolumeNegativeTest-476210608</nova:project>
Aug 14 15:11:58 user nova-compute[73254]:       </nova:owner>
Aug 14 15:11:58 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:11:58 user nova-compute[73254]:       <nova:ports>
Aug 14 15:11:58 user nova-compute[73254]:         <nova:port uuid="88db0d3f-4498-4bdf-97ef-d1a510af6302">
Aug 14 15:11:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 14 15:11:58 user nova-compute[73254]:         </nova:port>
Aug 14 15:11:58 user nova-compute[73254]:       </nova:ports>
Aug 14 15:11:58 user nova-compute[73254]:     </nova:instance>
Aug 14 15:11:58 user nova-compute[73254]:   </metadata>
Aug 14 15:11:58 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:11:58 user nova-compute[73254]:     <system>
Aug 14 15:11:58 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:11:58 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:11:58 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:11:58 user nova-compute[73254]:       <entry name="serial">0fe8688c-4e52-4105-8b7b-9c59d2b66cf8</entry>
Aug 14 15:11:58 user nova-compute[73254]:       <entry name="uuid">0fe8688c-4e52-4105-8b7b-9c59d2b66cf8</entry>
Aug 14 15:11:58 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:11:58 user nova-compute[73254]:     </system>
Aug 14 15:11:58 user nova-compute[73254]:   </sysinfo>
Aug 14 15:11:58 user nova-compute[73254]:   <os>
Aug 14 15:11:58 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:11:58 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:11:58 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:11:58 user nova-compute[73254]:   </os>
Aug 14 15:11:58 user nova-compute[73254]:   <features>
Aug 14 15:11:58 user nova-compute[73254]:     <acpi/>
Aug 14 15:11:58 user nova-compute[73254]:     <apic/>
Aug 14 15:11:58 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:11:58 user nova-compute[73254]:   </features>
Aug 14 15:11:58 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:11:58 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:11:58 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:11:58 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:11:58 user nova-compute[73254]:   </clock>
Aug 14 15:11:58 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:11:58 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:11:58 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:11:58 user nova-compute[73254]:   </cpu>
Aug 14 15:11:58 user nova-compute[73254]:   <devices>
Aug 14 15:11:58 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:11:58 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:11:58 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk"/>
Aug 14 15:11:58 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:11:58 user nova-compute[73254]:     </disk>
Aug 14 15:11:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:11:58 user nova-compute[73254]:       <mac address="fa:16:3e:c6:25:75"/>
Aug 14 15:11:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:11:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:11:58 user nova-compute[73254]:       <target dev="tap88db0d3f-44"/>
Aug 14 15:11:58 user nova-compute[73254]:     </interface>
Aug 14 15:11:58 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:11:58 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/console.log" append="off"/>
Aug 14 15:11:58 user nova-compute[73254]:     </serial>
Aug 14 15:11:58 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:11:58 user nova-compute[73254]:     <video>
Aug 14 15:11:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:11:58 user nova-compute[73254]:     </video>
Aug 14 15:11:58 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:11:58 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:11:58 user nova-compute[73254]:     </rng>
Aug 14 15:11:58 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:11:58 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:11:58 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:11:58 user nova-compute[73254]:     </memballoon>
Aug 14 15:11:58 user nova-compute[73254]:   </devices>
Aug 14 15:11:58 user nova-compute[73254]: </domain>
Aug 14 15:11:58 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-934313066',display_name='tempest-AttachVolumeNegativeTest-server-934313066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-934313066',id=33,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzh3uLdNezMQtvFvj1h98LABWVOVjNut4JKzobdKWwo4TTLKAsgtYnYekSoLFAVVCIRUaLvon8+fzWkqpXqu7InOnGw6A8gfhdOypPCs4Rs24209rJ82JVT3jzwsTajlQ==',key_name='tempest-keypair-314522417',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-905k87r2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:11:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=0fe8688c-4e52-4105-8b7b-9c59d2b66cf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:25:75,bridge_name='br-int',has_traffic_filtering=True,id=88db0d3f-4498-4bdf-97ef-d1a510af6302,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db0d3f-44') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG os_vif [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:25:75,bridge_name='br-int',has_traffic_filtering=True,id=88db0d3f-4498-4bdf-97ef-d1a510af6302,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db0d3f-44') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88db0d3f-44, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88db0d3f-44, col_values=(('external_ids', {'iface-id': '88db0d3f-4498-4bdf-97ef-d1a510af6302', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:25:75', 'vm-uuid': '0fe8688c-4e52-4105-8b7b-9c59d2b66cf8'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:11:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:11:58 user nova-compute[73254]: INFO os_vif [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:25:75,bridge_name='br-int',has_traffic_filtering=True,id=88db0d3f-4498-4bdf-97ef-d1a510af6302,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db0d3f-44')
Aug 14 15:11:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:11:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No VIF found with MAC fa:16:3e:c6:25:75, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:11:59 user nova-compute[73254]: DEBUG nova.network.neutron [req-bbbb3bb6-6565-431b-ba03-c821e05e047e req-48fd3642-2b32-4330-bd63-9ffdc2a889fe service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Updated VIF entry in instance network info cache for port 88db0d3f-4498-4bdf-97ef-d1a510af6302. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:11:59 user nova-compute[73254]: DEBUG nova.network.neutron [req-bbbb3bb6-6565-431b-ba03-c821e05e047e req-48fd3642-2b32-4330-bd63-9ffdc2a889fe service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Updating instance_info_cache with network_info: [{"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:11:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bbbb3bb6-6565-431b-ba03-c821e05e047e req-48fd3642-2b32-4330-bd63-9ffdc2a889fe service nova] Releasing lock "refresh_cache-0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-8a9d19dd-cbf2-4a56-a173-67f3f1924080 req-0a6f1fc5-e90f-4c5e-bbfd-d2bb30672740 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received event network-vif-plugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8a9d19dd-cbf2-4a56-a173-67f3f1924080 req-0a6f1fc5-e90f-4c5e-bbfd-d2bb30672740 service nova] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8a9d19dd-cbf2-4a56-a173-67f3f1924080 req-0a6f1fc5-e90f-4c5e-bbfd-d2bb30672740 service nova] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8a9d19dd-cbf2-4a56-a173-67f3f1924080 req-0a6f1fc5-e90f-4c5e-bbfd-d2bb30672740 service nova] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-8a9d19dd-cbf2-4a56-a173-67f3f1924080 req-0a6f1fc5-e90f-4c5e-bbfd-d2bb30672740 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] No waiting events found dispatching network-vif-plugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:12:00 user nova-compute[73254]: WARNING nova.compute.manager [req-8a9d19dd-cbf2-4a56-a173-67f3f1924080 req-0a6f1fc5-e90f-4c5e-bbfd-d2bb30672740 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received unexpected event network-vif-plugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 for instance with vm_state building and task_state spawning.
Aug 14 15:12:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-ac1bfcb7-bacd-482d-911b-a992a03f9cc1 req-21081703-413d-4bde-9093-1e0e706e32f4 service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received event network-changed-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-ac1bfcb7-bacd-482d-911b-a992a03f9cc1 req-21081703-413d-4bde-9093-1e0e706e32f4 service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Refreshing instance network info cache due to event network-changed-fd7dd171-0b9c-474e-9f9f-15662377fdae. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ac1bfcb7-bacd-482d-911b-a992a03f9cc1 req-21081703-413d-4bde-9093-1e0e706e32f4 service nova] Acquiring lock "refresh_cache-e1e2c36c-4583-4c4b-bc16-38b891a1be78" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ac1bfcb7-bacd-482d-911b-a992a03f9cc1 req-21081703-413d-4bde-9093-1e0e706e32f4 service nova] Acquired lock "refresh_cache-e1e2c36c-4583-4c4b-bc16-38b891a1be78" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG nova.network.neutron [req-ac1bfcb7-bacd-482d-911b-a992a03f9cc1 req-21081703-413d-4bde-9093-1e0e706e32f4 service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Refreshing network info cache for port fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025905.8978171, 35c77333-bc2c-429b-a65f-dd87ae2bfe25 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:12:00 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] VM Stopped (Lifecycle Event)
Aug 14 15:12:00 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7afbce6a-1bc0-407f-82eb-f12eba14de66 None None] [instance: 35c77333-bc2c-429b-a65f-dd87ae2bfe25] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG nova.objects.instance [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'flavor' on Instance uuid e1e2c36c-4583-4c4b-bc16-38b891a1be78 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:12:01 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Ignoring supplied device name: /dev/vdb
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:01 user nova-compute[73254]: INFO nova.compute.manager [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Attaching volume 44727434-ebe0-42e7-bd16-9ed5c34ff0f1 to /dev/vdb
Aug 14 15:12:01 user nova-compute[73254]: DEBUG os_brick.utils [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG nova.network.neutron [req-ac1bfcb7-bacd-482d-911b-a992a03f9cc1 req-21081703-413d-4bde-9093-1e0e706e32f4 service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Updated VIF entry in instance network info cache for port fd7dd171-0b9c-474e-9f9f-15662377fdae. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG nova.network.neutron [req-ac1bfcb7-bacd-482d-911b-a992a03f9cc1 req-21081703-413d-4bde-9093-1e0e706e32f4 service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Updating instance_info_cache with network_info: [{"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe021b8-ef36-4cc1-8ebd-cc1736318d5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ac1bfcb7-bacd-482d-911b-a992a03f9cc1 req-21081703-413d-4bde-9093-1e0e706e32f4 service nova] Releasing lock "refresh_cache-e1e2c36c-4583-4c4b-bc16-38b891a1be78" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a3faaf-ff6e-4c58-a3f2-1f9e39430b90]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[64410589-b7e9-4b35-92a9-057d175f8f66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e02e90-ae6a-4507-963b-f6f113f8f377]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:12:01 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:12:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed69499-e558-4c90-9eb1-3056521c452c]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG os_brick.utils [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Updating existing volume attachment record: fea6f9db-7331-4137-a25a-947086c0445e {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:12:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025922.4671512, 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:12:02 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] VM Resumed (Lifecycle Event)
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:12:02 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Instance spawned successfully.
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:12:02 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025922.4686208, 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:12:02 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] VM Started (Lifecycle Event)
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:12:02 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:12:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:12:02 user nova-compute[73254]: INFO nova.compute.manager [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Took 5.60 seconds to spawn the instance on the hypervisor.
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-0b8cd53f-f3f5-49ec-9cce-79f07a3077cc req-6abbb178-c9d2-4eb7-ac61-88b3297f2e38 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received event network-vif-plugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0b8cd53f-f3f5-49ec-9cce-79f07a3077cc req-6abbb178-c9d2-4eb7-ac61-88b3297f2e38 service nova] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0b8cd53f-f3f5-49ec-9cce-79f07a3077cc req-6abbb178-c9d2-4eb7-ac61-88b3297f2e38 service nova] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0b8cd53f-f3f5-49ec-9cce-79f07a3077cc req-6abbb178-c9d2-4eb7-ac61-88b3297f2e38 service nova] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-0b8cd53f-f3f5-49ec-9cce-79f07a3077cc req-6abbb178-c9d2-4eb7-ac61-88b3297f2e38 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] No waiting events found dispatching network-vif-plugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:12:02 user nova-compute[73254]: WARNING nova.compute.manager [req-0b8cd53f-f3f5-49ec-9cce-79f07a3077cc req-6abbb178-c9d2-4eb7-ac61-88b3297f2e38 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received unexpected event network-vif-plugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 for instance with vm_state building and task_state spawning.
Aug 14 15:12:02 user nova-compute[73254]: INFO nova.compute.manager [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Took 6.41 seconds to build instance.
Aug 14 15:12:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ff365900-771b-43b6-8354-be208751db0b tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.711s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.222s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:12:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7392MB free_disk=25.05074691772461GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a651971c-b3b5-490b-b09e-6f93be59c663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e1e2c36c-4583-4c4b-bc16-38b891a1be78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:12:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnZzDkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:12:11 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:12:11 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:12:11 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5174de1-ea4b-4007-b72e-0871027604dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:12:11 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e95cd9e-344e-468c-9895-de7eaa8d0dcb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1] added
Aug 14 15:12:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[56955de1-97f9-4dfd-b890-2791b04549d1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[444378f9-1597-45a5-ac51-832577b0bfec]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnZzDkdt {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RnZzDkdt" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[362b2f53-e0de-4ff3-8b0c-79d3d3ee5996]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RnZzDkdt'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6f5482-5161-4123-97b6-bfa3d4f5fbf5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e77664-b910-4b8c-b95c-9b4174ec3d24]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:12:11 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:12:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:12:11 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:12:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d89fcd-b761-4fca-b52a-5ef0b3717c6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1, portal: 172.16.0.220,3260]
Aug 14 15:12:11 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1, portal: 172.16.0.220,3260] successful.
Aug 14 15:12:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c06c736-f585-4e31-b025-d7b3d2f875ce]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b666fd-087a-46e2-b9a8-6a1e701b5ec3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:12:11 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:12:11 user nova-compute[73254]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 (non-flash)
Aug 14 15:12:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:12:11 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:12:11 user nova-compute[73254]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 (non-flash)
Aug 14 15:12:11 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b686557b-b5b2-4031-bd25-6271e7b1af0a]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnZzDkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:12:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:12:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23266613361366364', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:12:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266613361366364', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:12:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'flavor' on Instance uuid e1e2c36c-4583-4c4b-bc16-38b891a1be78 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:12:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:12:12 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:12:12 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:12:12 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:12:12 user nova-compute[73254]:   <serial>44727434-ebe0-42e7-bd16-9ed5c34ff0f1</serial>
Aug 14 15:12:12 user nova-compute[73254]: </disk>
Aug 14 15:12:12 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] No VIF found with MAC fa:16:3e:af:9d:8e, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-12df99f5-0fb2-4cc2-90d3-c2ec6dabd7c0 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.034s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:12:13 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updating instance_info_cache with network_info: [{"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:12:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:12:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:12:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:53 user nova-compute[73254]: INFO nova.compute.manager [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Detaching volume 44727434-ebe0-42e7-bd16-9ed5c34ff0f1
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:53 user nova-compute[73254]: INFO nova.virt.block_device [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Attempting to driver detach volume 44727434-ebe0-42e7-bd16-9ed5c34ff0f1 from mountpoint /dev/vdb
Aug 14 15:12:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Attempting to detach device vdb from instance e1e2c36c-4583-4c4b-bc16-38b891a1be78 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:12:53 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:12:53 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:12:53 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:12:53 user nova-compute[73254]:   <serial>44727434-ebe0-42e7-bd16-9ed5c34ff0f1</serial>
Aug 14 15:12:53 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:12:53 user nova-compute[73254]: </disk>
Aug 14 15:12:53 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:12:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Successfully detached device vdb from instance e1e2c36c-4583-4c4b-bc16-38b891a1be78 from the persistent domain config.
Aug 14 15:12:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1e2c36c-4583-4c4b-bc16-38b891a1be78 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:12:53 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:12:53 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:12:53 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:12:53 user nova-compute[73254]:   <serial>44727434-ebe0-42e7-bd16-9ed5c34ff0f1</serial>
Aug 14 15:12:53 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:12:53 user nova-compute[73254]: </disk>
Aug 14 15:12:53 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692025973.6927743, e1e2c36c-4583-4c4b-bc16-38b891a1be78 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1e2c36c-4583-4c4b-bc16-38b891a1be78 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:12:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Successfully detached device vdb from instance e1e2c36c-4583-4c4b-bc16-38b891a1be78 from the live domain config.
Aug 14 15:12:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnZzDkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:12:53 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c43bac-f4af-4135-83d4-2309f375085f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc65634f-302f-4dad-8692-40ed345c1fd4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:12:53 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:12:53 user nova-compute[73254]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 (non-flash)
Aug 14 15:12:53 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:12:53 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:12:53 user nova-compute[73254]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 (non-flash)
Aug 14 15:12:53 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648689fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1'): ({'sdd'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Removing single pathed devices sdd {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69491e4-48ec-45c9-846a-c05119c18b0f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82d0ae9-cadd-4a31-974d-b8eee3b64a6f]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Flushing IO for device /dev/sdd {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b812fc34-56f9-4ec4-8d75-af752fd5f8e8]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fea2c0-5656-4b09-aa9b-46448b56bbe7]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8302fd6-9617-4dde-91e4-3f142d09890d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c693453-8f1e-48a5-b7af-83a6fe6ffcb9]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1, portal: 172.16.0.220,3260]
Aug 14 15:12:53 user nova-compute[73254]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1, portal: 172.16.0.220,3260] successful.
Aug 14 15:12:53 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[161638f6-10e7-4d16-bf6c-462b4cd08e86]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] <== disconnect_volume: return (285ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:12:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG nova.objects.instance [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'flavor' on Instance uuid e1e2c36c-4583-4c4b-bc16-38b891a1be78 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cb7e2fd8-ba2e-4dbc-b07e-91e01c7421ac tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.834s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.711s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:54 user nova-compute[73254]: INFO nova.compute.manager [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Terminating instance
Aug 14 15:12:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-72905acd-473c-4b74-a764-91e6fe0ec0d0 req-488a57ab-ea60-4da0-a07a-8822a7fceed8 service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received event network-vif-unplugged-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72905acd-473c-4b74-a764-91e6fe0ec0d0 req-488a57ab-ea60-4da0-a07a-8822a7fceed8 service nova] Acquiring lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72905acd-473c-4b74-a764-91e6fe0ec0d0 req-488a57ab-ea60-4da0-a07a-8822a7fceed8 service nova] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72905acd-473c-4b74-a764-91e6fe0ec0d0 req-488a57ab-ea60-4da0-a07a-8822a7fceed8 service nova] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-72905acd-473c-4b74-a764-91e6fe0ec0d0 req-488a57ab-ea60-4da0-a07a-8822a7fceed8 service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] No waiting events found dispatching network-vif-unplugged-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-72905acd-473c-4b74-a764-91e6fe0ec0d0 req-488a57ab-ea60-4da0-a07a-8822a7fceed8 service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received event network-vif-unplugged-fd7dd171-0b9c-474e-9f9f-15662377fdae for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:12:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Instance destroyed successfully.
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'resources' on Instance uuid e1e2c36c-4583-4c4b-bc16-38b891a1be78 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:10:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1314775822',display_name='tempest-VolumesSnapshotTestJSON-instance-1314775822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1314775822',id=31,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWLb6YvHjwrNCwLKhT3FaZBVHLfLPSRf6jAH1DoViJryeY48WglvbVCCZ0C7WDmcg5aStfbcEc4a1/6LkjRjo0ssyVFHpqn3c5rINtHlNvEFNDb22jgnmItN6T9si/gdQ==',key_name='tempest-keypair-1269624836',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d51019cbe3a4ce694c44fd294c26e76',ramdisk_id='',reservation_id='r-r070f7sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1785106285',owner_user_name='tempest-VolumesSnapshotTestJSON-1785106285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c372e49b3d04765aa35916ba8e2e0f8',uuid=e1e2c36c-4583-4c4b-bc16-38b891a1be78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converting VIF {"id": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "address": "fa:16:3e:af:9d:8e", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.14", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd7dd171-0b", "ovs_interfaceid": "fd7dd171-0b9c-474e-9f9f-15662377fdae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:9d:8e,bridge_name='br-int',has_traffic_filtering=True,id=fd7dd171-0b9c-474e-9f9f-15662377fdae,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dd171-0b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_vif [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:9d:8e,bridge_name='br-int',has_traffic_filtering=True,id=fd7dd171-0b9c-474e-9f9f-15662377fdae,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dd171-0b') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd7dd171-0b, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:12:55 user nova-compute[73254]: INFO os_vif [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:9d:8e,bridge_name='br-int',has_traffic_filtering=True,id=fd7dd171-0b9c-474e-9f9f-15662377fdae,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd7dd171-0b')
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RnZzDkdt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:12:55 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44727434-ebe0-42e7-bd16-9ed5c34ff0f1', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b016661-9949-4c3e-9eb0-f4df45eff0d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd4c8f9-d94a-4f28-a822-3497e0111670]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:12:55 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:12:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:12:55 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:12:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6485536d0>, {}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Disconnecting from: [] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] <== disconnect_volume: return (49ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:12:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Deleting instance files /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78_del
Aug 14 15:12:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Deletion of /opt/stack/data/nova/instances/e1e2c36c-4583-4c4b-bc16-38b891a1be78_del complete
Aug 14 15:12:55 user nova-compute[73254]: INFO nova.compute.manager [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 14 15:12:55 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:12:55 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:12:56 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:12:57 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Took 1.18 seconds to deallocate network for instance.
Aug 14 15:12:57 user nova-compute[73254]: WARNING nova.volume.cinder [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Attachment fea6f9db-7331-4137-a25a-947086c0445e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = fea6f9db-7331-4137-a25a-947086c0445e. (HTTP 404) (Request-ID: req-9ba1ae63-a86c-469a-869f-942c30a7da4e)
Aug 14 15:12:57 user nova-compute[73254]: INFO nova.compute.manager [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Took 0.03 seconds to detach 1 volumes for instance.
Aug 14 15:12:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-65c293ae-f155-4b52-8959-57c3761e3d66 req-360337e6-69bb-4edc-af27-ba1f7265917b service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received event network-vif-plugged-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:12:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-65c293ae-f155-4b52-8959-57c3761e3d66 req-360337e6-69bb-4edc-af27-ba1f7265917b service nova] Acquiring lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-65c293ae-f155-4b52-8959-57c3761e3d66 req-360337e6-69bb-4edc-af27-ba1f7265917b service nova] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-65c293ae-f155-4b52-8959-57c3761e3d66 req-360337e6-69bb-4edc-af27-ba1f7265917b service nova] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-65c293ae-f155-4b52-8959-57c3761e3d66 req-360337e6-69bb-4edc-af27-ba1f7265917b service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] No waiting events found dispatching network-vif-plugged-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:12:57 user nova-compute[73254]: WARNING nova.compute.manager [req-65c293ae-f155-4b52-8959-57c3761e3d66 req-360337e6-69bb-4edc-af27-ba1f7265917b service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received unexpected event network-vif-plugged-fd7dd171-0b9c-474e-9f9f-15662377fdae for instance with vm_state deleted and task_state None.
Aug 14 15:12:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-65c293ae-f155-4b52-8959-57c3761e3d66 req-360337e6-69bb-4edc-af27-ba1f7265917b service nova] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Received event network-vif-deleted-fd7dd171-0b9c-474e-9f9f-15662377fdae {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:12:57 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:12:57 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:12:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:57 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Deleted allocations for instance e1e2c36c-4583-4c4b-bc16-38b891a1be78
Aug 14 15:12:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d555d6d5-b864-4806-9bec-b1aceee39a1e tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "e1e2c36c-4583-4c4b-bc16-38b891a1be78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.629s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'flavor' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:12:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:12:59 user nova-compute[73254]: INFO nova.compute.manager [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Attaching volume cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 to /dev/vdb
Aug 14 15:12:59 user nova-compute[73254]: DEBUG os_brick.utils [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d6df7d-6bdf-4dc4-876e-db001d750775]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[670f3621-6f60-4344-9594-799ed40fd6ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7365466-5bd9-4b9f-9469-40b05f592a5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f194c5-af33-4ff1-a116-5715ba580262]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:12:59 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:12:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf7a30f-cdba-46f8-a474-1cb01df11a34]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG os_brick.utils [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:12:59 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updating existing volume attachment record: a0145b1f-2189-4795-8a8b-784d92edda69 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:13:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:02 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:13:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:07 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:13:07 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7622MB free_disk=25.08557891845703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a651971c-b3b5-490b-b09e-6f93be59c663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:13:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFxJwRrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:13:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:13:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:13:08 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f121db32-d2d7-457f-a898-b54e698a6eef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:13:08 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cce9a2-5367-4690-9ff4-d121eaacec86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1] added
Aug 14 15:13:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53b68ed-913b-4f12-a9e7-84a1150b25d3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[aace1b71-82e1-4516-b1e3-0e05b4f2bb5d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFxJwRrA {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFxJwRrA" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3a56aa-e12f-4aa0-8b6d-a524153529bd]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yFxJwRrA'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f64df51-8037-497a-866f-04a84ca81be6]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d1138c-6812-4e63-b3da-83d127e160bc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:13:09 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:13:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:13:09 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:13:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbefad8-d03f-4079-9054-df2c76fef7cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1, portal: 172.16.0.220,3260]
Aug 14 15:13:09 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1, portal: 172.16.0.220,3260] successful.
Aug 14 15:13:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0e24ab-ab5c-427d-b58f-6e06a00129ee]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ce277a-20b8-46b7-9a8c-d3d5deb24718]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:13:09 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:13:09 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:13:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:13:09 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:13:09 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:13:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92a827f-fc81-41ea-8b96-b07dcc1385e1]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFxJwRrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "0578772b-534f-4d29-9b68-d9b691d339e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:13:09 user nova-compute[73254]: INFO nova.compute.claims [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Claim successful on node user
Aug 14 15:13:09 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:13:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.344s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '26461393030353939', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461393030353939', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.objects.instance [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'flavor' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:13:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Creating image(s)
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "/opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "/opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "/opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.policy [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ca9fb4530574c44b1a3cfa6e1b90871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7879ba4750fa40cf9ee6bfb1daf85fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:13:10 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:13:10 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:13:10 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:13:10 user nova-compute[73254]:   <serial>cceba3b0-c8cb-40d1-92cf-9bc8d75100b1</serial>
Aug 14 15:13:10 user nova-compute[73254]: </disk>
Aug 14 15:13:10 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692025975.6667104, e1e2c36c-4583-4c4b-bc16-38b891a1be78 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:13:10 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] VM Stopped (Lifecycle Event)
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bebcb5fa-814e-457b-84e0-b71adead2386 None None] [instance: e1e2c36c-4583-4c4b-bc16-38b891a1be78] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk 1073741824" returned: 0 in 0.148s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] No VIF found with MAC fa:16:3e:df:e2:76, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-592907b1-b2a8-45b1-8ed5-9857021c38cf tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.739s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Cannot resize image /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG nova.objects.instance [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'migration_context' on Instance uuid 0578772b-534f-4d29-9b68-d9b691d339e0 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Ensure instance console log exists: /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Successfully created port: dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:13:11 user nova-compute[73254]: INFO nova.compute.manager [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Rescuing
Aug 14 15:13:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquired lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updating instance_info_cache with network_info: [{"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:13:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Releasing lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Successfully updated port: dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "refresh_cache-0578772b-534f-4d29-9b68-d9b691d339e0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquired lock "refresh_cache-0578772b-534f-4d29-9b68-d9b691d339e0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-9d36170c-8073-496e-86de-dc3efa2cac9c req-5cd6c3ec-d3f8-464c-b6a4-1f7c7dd90d9a service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received event network-changed-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-9d36170c-8073-496e-86de-dc3efa2cac9c req-5cd6c3ec-d3f8-464c-b6a4-1f7c7dd90d9a service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Refreshing instance network info cache due to event network-changed-dff7b46e-eb91-40f5-89cc-8dc92aa35544. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d36170c-8073-496e-86de-dc3efa2cac9c req-5cd6c3ec-d3f8-464c-b6a4-1f7c7dd90d9a service nova] Acquiring lock "refresh_cache-0578772b-534f-4d29-9b68-d9b691d339e0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Updating instance_info_cache with network_info: [{"id": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "address": "fa:16:3e:9c:f8:ab", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7b46e-eb", "ovs_interfaceid": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Releasing lock "refresh_cache-0578772b-534f-4d29-9b68-d9b691d339e0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Instance network_info: |[{"id": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "address": "fa:16:3e:9c:f8:ab", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7b46e-eb", "ovs_interfaceid": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d36170c-8073-496e-86de-dc3efa2cac9c req-5cd6c3ec-d3f8-464c-b6a4-1f7c7dd90d9a service nova] Acquired lock "refresh_cache-0578772b-534f-4d29-9b68-d9b691d339e0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.network.neutron [req-9d36170c-8073-496e-86de-dc3efa2cac9c req-5cd6c3ec-d3f8-464c-b6a4-1f7c7dd90d9a service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Refreshing network info cache for port dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Start _get_guest_xml network_info=[{"id": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "address": "fa:16:3e:9c:f8:ab", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7b46e-eb", "ovs_interfaceid": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:13:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:13:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1222166842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1222166842',id=34,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-1y9om90x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:13:10Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=0578772b-534f-4d29-9b68-d9b691d339e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "address": "fa:16:3e:9c:f8:ab", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7b46e-eb", "ovs_interfaceid": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "address": "fa:16:3e:9c:f8:ab", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7b46e-eb", "ovs_interfaceid": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=dff7b46e-eb91-40f5-89cc-8dc92aa35544,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7b46e-eb') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'pci_devices' on Instance uuid 0578772b-534f-4d29-9b68-d9b691d339e0 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:13:12 user nova-compute[73254]:   <uuid>0578772b-534f-4d29-9b68-d9b691d339e0</uuid>
Aug 14 15:13:12 user nova-compute[73254]:   <name>instance-00000022</name>
Aug 14 15:13:12 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:13:12 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:13:12 user nova-compute[73254]:   <metadata>
Aug 14 15:13:12 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:13:12 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:13:12 user nova-compute[73254]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1222166842</nova:name>
Aug 14 15:13:12 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:13:12</nova:creationTime>
Aug 14 15:13:12 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:13:12 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:13:12 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:13:12 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:13:12 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:13:12 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:13:12 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:13:12 user nova-compute[73254]:       <nova:owner>
Aug 14 15:13:12 user nova-compute[73254]:         <nova:user uuid="4ca9fb4530574c44b1a3cfa6e1b90871">tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member</nova:user>
Aug 14 15:13:12 user nova-compute[73254]:         <nova:project uuid="7879ba4750fa40cf9ee6bfb1daf85fdf">tempest-ServerBootFromVolumeStableRescueTest-1955280356</nova:project>
Aug 14 15:13:12 user nova-compute[73254]:       </nova:owner>
Aug 14 15:13:12 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:13:12 user nova-compute[73254]:       <nova:ports>
Aug 14 15:13:12 user nova-compute[73254]:         <nova:port uuid="dff7b46e-eb91-40f5-89cc-8dc92aa35544">
Aug 14 15:13:12 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 14 15:13:12 user nova-compute[73254]:         </nova:port>
Aug 14 15:13:12 user nova-compute[73254]:       </nova:ports>
Aug 14 15:13:12 user nova-compute[73254]:     </nova:instance>
Aug 14 15:13:12 user nova-compute[73254]:   </metadata>
Aug 14 15:13:12 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:13:12 user nova-compute[73254]:     <system>
Aug 14 15:13:12 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:13:12 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:13:12 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:13:12 user nova-compute[73254]:       <entry name="serial">0578772b-534f-4d29-9b68-d9b691d339e0</entry>
Aug 14 15:13:12 user nova-compute[73254]:       <entry name="uuid">0578772b-534f-4d29-9b68-d9b691d339e0</entry>
Aug 14 15:13:12 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:13:12 user nova-compute[73254]:     </system>
Aug 14 15:13:12 user nova-compute[73254]:   </sysinfo>
Aug 14 15:13:12 user nova-compute[73254]:   <os>
Aug 14 15:13:12 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:13:12 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:13:12 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:13:12 user nova-compute[73254]:   </os>
Aug 14 15:13:12 user nova-compute[73254]:   <features>
Aug 14 15:13:12 user nova-compute[73254]:     <acpi/>
Aug 14 15:13:12 user nova-compute[73254]:     <apic/>
Aug 14 15:13:12 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:13:12 user nova-compute[73254]:   </features>
Aug 14 15:13:12 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:13:12 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:13:12 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:13:12 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:13:12 user nova-compute[73254]:   </clock>
Aug 14 15:13:12 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:13:12 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:13:12 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:13:12 user nova-compute[73254]:   </cpu>
Aug 14 15:13:12 user nova-compute[73254]:   <devices>
Aug 14 15:13:12 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:13:12 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:13:12 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk"/>
Aug 14 15:13:12 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:13:12 user nova-compute[73254]:     </disk>
Aug 14 15:13:12 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:13:12 user nova-compute[73254]:       <mac address="fa:16:3e:9c:f8:ab"/>
Aug 14 15:13:12 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:13:12 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:13:12 user nova-compute[73254]:       <target dev="tapdff7b46e-eb"/>
Aug 14 15:13:12 user nova-compute[73254]:     </interface>
Aug 14 15:13:12 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:13:12 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/console.log" append="off"/>
Aug 14 15:13:12 user nova-compute[73254]:     </serial>
Aug 14 15:13:12 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:13:12 user nova-compute[73254]:     <video>
Aug 14 15:13:12 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:13:12 user nova-compute[73254]:     </video>
Aug 14 15:13:12 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:13:12 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:13:12 user nova-compute[73254]:     </rng>
Aug 14 15:13:12 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:13:12 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:13:12 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:13:12 user nova-compute[73254]:     </memballoon>
Aug 14 15:13:12 user nova-compute[73254]:   </devices>
Aug 14 15:13:12 user nova-compute[73254]: </domain>
Aug 14 15:13:12 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1222166842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1222166842',id=34,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-1y9om90x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:13:10Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=0578772b-534f-4d29-9b68-d9b691d339e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "address": "fa:16:3e:9c:f8:ab", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7b46e-eb", "ovs_interfaceid": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "address": "fa:16:3e:9c:f8:ab", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7b46e-eb", "ovs_interfaceid": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=dff7b46e-eb91-40f5-89cc-8dc92aa35544,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7b46e-eb') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG os_vif [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=dff7b46e-eb91-40f5-89cc-8dc92aa35544,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7b46e-eb') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdff7b46e-eb, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdff7b46e-eb, col_values=(('external_ids', {'iface-id': 'dff7b46e-eb91-40f5-89cc-8dc92aa35544', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:f8:ab', 'vm-uuid': '0578772b-534f-4d29-9b68-d9b691d339e0'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:12 user nova-compute[73254]: INFO os_vif [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=dff7b46e-eb91-40f5-89cc-8dc92aa35544,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7b46e-eb')
Aug 14 15:13:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Instance destroyed successfully.
Aug 14 15:13:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Attempting a stable device rescue
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No VIF found with MAC fa:16:3e:9c:f8:ab, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73254) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Instance directory exists: not creating {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 15:13:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Creating image(s)
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'trusted_certs' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "9f1d9e710686943fd923213c7a25acae3b98073a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "9f1d9e710686943fd923213c7a25acae3b98073a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a.part --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a.part --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.virt.images [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] fc2d1b6d-7c9d-4d6e-93f9-100ec5c2a0a0 was qcow2, converting to raw {{(pid=73254) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a.part /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a.converted {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-unplugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-unplugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:13:14 user nova-compute[73254]: WARNING nova.compute.manager [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-unplugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state active and task_state rescuing.
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:13:14 user nova-compute[73254]: WARNING nova.compute.manager [req-19062216-19af-41f8-b985-57f583d4577a req-ce7c5d24-461c-4c37-8418-4e87b52bae8c service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state active and task_state rescuing.
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.network.neutron [req-9d36170c-8073-496e-86de-dc3efa2cac9c req-5cd6c3ec-d3f8-464c-b6a4-1f7c7dd90d9a service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Updated VIF entry in instance network info cache for port dff7b46e-eb91-40f5-89cc-8dc92aa35544. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.network.neutron [req-9d36170c-8073-496e-86de-dc3efa2cac9c req-5cd6c3ec-d3f8-464c-b6a4-1f7c7dd90d9a service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Updating instance_info_cache with network_info: [{"id": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "address": "fa:16:3e:9c:f8:ab", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7b46e-eb", "ovs_interfaceid": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d36170c-8073-496e-86de-dc3efa2cac9c req-5cd6c3ec-d3f8-464c-b6a4-1f7c7dd90d9a service nova] Releasing lock "refresh_cache-0578772b-534f-4d29-9b68-d9b691d339e0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Updating instance_info_cache with network_info: [{"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-52930af7-b452-4bff-a8cb-7e7859f99af6" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-81e00e3f-68ec-449f-8d59-48f3239331a0 req-9970f145-57a4-4aab-ad69-38288b92e03c service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-81e00e3f-68ec-449f-8d59-48f3239331a0 req-9970f145-57a4-4aab-ad69-38288b92e03c service nova] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-81e00e3f-68ec-449f-8d59-48f3239331a0 req-9970f145-57a4-4aab-ad69-38288b92e03c service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-81e00e3f-68ec-449f-8d59-48f3239331a0 req-9970f145-57a4-4aab-ad69-38288b92e03c service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-81e00e3f-68ec-449f-8d59-48f3239331a0 req-9970f145-57a4-4aab-ad69-38288b92e03c service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] No waiting events found dispatching network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:13:14 user nova-compute[73254]: WARNING nova.compute.manager [req-81e00e3f-68ec-449f-8d59-48f3239331a0 req-9970f145-57a4-4aab-ad69-38288b92e03c service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received unexpected event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 for instance with vm_state building and task_state spawning.
Aug 14 15:13:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a.part /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a.converted" returned: 0 in 0.585s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a.converted --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "9f1d9e710686943fd923213c7a25acae3b98073a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.078s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "9f1d9e710686943fd923213c7a25acae3b98073a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "9f1d9e710686943fd923213c7a25acae3b98073a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a,backing_fmt=raw /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.rescue {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a,backing_fmt=raw /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.rescue" returned: 0 in 0.055s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "9f1d9e710686943fd923213c7a25acae3b98073a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'migration_context' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Start _get_guest_xml network_info=[{"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "vif_mac": "fa:16:3e:df:e2:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fc2d1b6d-7c9d-4d6e-93f9-100ec5c2a0a0', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'a0145b1f-2189-4795-8a8b-784d92edda69', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFxJwRrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'a651971c-b3b5-490b-b09e-6f93be59c663', 'attached_at': '', 'detached_at': '', 'volume_id': 'cceba3b0-c8cb-40d1-92cf-9bc8d75100b1', 'serial': 'cceba3b0-c8cb-40d1-92cf-9bc8d75100b1'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'resources' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'numa_topology' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:15 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:13:15 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'vcpu_model' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFxJwRrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:13:15 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:13:15 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:13:15 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d83c7a-5829-49fe-a3cc-386b14a688f2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yFxJwRrA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 15:13:15 user nova-compute[73254]: node.name = iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1
Aug 14 15:13:15 user nova-compute[73254]: node.tpgt = -1
Aug 14 15:13:15 user nova-compute[73254]: node.startup = automatic
Aug 14 15:13:15 user nova-compute[73254]: node.leading_login = No
Aug 14 15:13:15 user nova-compute[73254]: iface.iscsi_ifacename = default
Aug 14 15:13:15 user nova-compute[73254]: iface.net_ifacename = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.ipaddress = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.prefix_len = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.hwaddress = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.transport_name = tcp
Aug 14 15:13:15 user nova-compute[73254]: iface.initiatorname = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.state = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.vlan_id = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.vlan_priority = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.vlan_state = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.iface_num = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.mtu = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.port = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.bootproto = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.subnet_mask = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.gateway = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.dhcp_alt_client_id = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.dhcp_dns = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.dhcp_learn_iqn = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.dhcp_vendor_id_state = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.dhcp_vendor_id = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.dhcp_slp_da = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.fragmentation = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.gratuitous_arp = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.incoming_forwarding = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.tos_state = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.tos = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.ttl = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.delayed_ack = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.tcp_nagle = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.tcp_wsf_state = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.tcp_wsf = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.tcp_timer_scale = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.tcp_timestamp = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.redirect = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.def_task_mgmt_timeout = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.header_digest = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.data_digest = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.immediate_data = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.initial_r2t = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.data_seq_inorder = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.data_pdu_inorder = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.erl = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.max_receive_data_len = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.first_burst_len = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.max_outstanding_r2t = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.max_burst_len = 0
Aug 14 15:13:15 user nova-compute[73254]: iface.chap_auth = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.bidi_chap = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.strict_login_compliance = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.discovery_auth = <empty>
Aug 14 15:13:15 user nova-compute[73254]: iface.discovery_logout = <empty>
Aug 14 15:13:15 user nova-compute[73254]: node.discovery_address = <empty>
Aug 14 15:13:15 user nova-compute[73254]: node.discovery_port = 0
Aug 14 15:13:15 user nova-compute[73254]: node.discovery_type = static
Aug 14 15:13:15 user nova-compute[73254]: node.session.initial_cmdsn = 0
Aug 14 15:13:15 user nova-compute[73254]: node.session.initial_login_retry_max = 8
Aug 14 15:13:15 user nova-compute[73254]: node.session.xmit_thread_priority = -20
Aug 14 15:13:15 user nova-compute[73254]: node.session.cmds_max = 128
Aug 14 15:13:15 user nova-compute[73254]: node.session.queue_depth = 32
Aug 14 15:13:15 user nova-compute[73254]: node.session.nr_sessions = 1
Aug 14 15:13:15 user nova-compute[73254]: node.session.auth.authmethod = CHAP
Aug 14 15:13:15 user nova-compute[73254]: node.session.auth.username = yFxJwRrA
Aug 14 15:13:15 user nova-compute[73254]: node.session.auth.password = ***
Aug 14 15:13:15 user nova-compute[73254]: node.session.auth.username_in = <empty>
Aug 14 15:13:15 user nova-compute[73254]: node.session.auth.password_in = <empty>
Aug 14 15:13:15 user nova-compute[73254]: node.session.auth.chap_algs = MD5
Aug 14 15:13:15 user nova-compute[73254]: node.session.timeo.replacement_timeout = 120
Aug 14 15:13:15 user nova-compute[73254]: node.session.err_timeo.abort_timeout = 15
Aug 14 15:13:15 user nova-compute[73254]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 15:13:15 user nova-compute[73254]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 15:13:15 user nova-compute[73254]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 15:13:15 user nova-compute[73254]: node.session.iscsi.FastAbort = Yes
Aug 14 15:13:15 user nova-compute[73254]: node.session.iscsi.InitialR2T = No
Aug 14 15:13:15 user nova-compute[73254]: node.session.iscsi.ImmediateData = Yes
Aug 14 15:13:15 user nova-compute[73254]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 15:13:15 user nova-compute[73254]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 15:13:15 user nova-compute[73254]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 15:13:15 user nova-compute[73254]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 15:13:15 user nova-compute[73254]: node.session.iscsi.MaxConnections = 1
Aug 14 15:13:15 user nova-compute[73254]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 15:13:15 user nova-compute[73254]: node.session.iscsi.ERL = 0
Aug 14 15:13:15 user nova-compute[73254]: node.session.scan = manual
Aug 14 15:13:15 user nova-compute[73254]: node.session.reopen_max = 0
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].address = 172.16.0.220
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].port = 3260
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].startup = manual
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].tcp.window_size = 524288
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].tcp.type_of_service = 0
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].timeo.logout_timeout = 15
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].timeo.login_timeout = 15
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].timeo.auth_timeout = 45
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].iscsi.DataDigest = None
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].iscsi.IFMarker = No
Aug 14 15:13:15 user nova-compute[73254]: node.conn[0].iscsi.OFMarker = No
Aug 14 15:13:15 user nova-compute[73254]: # END RECORD
Aug 14 15:13:15 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2957b19b-66e1-45cd-9099-2be838dc2f61]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[92922991-c9cd-471c-88e0-a71fe6b9db78]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFxJwRrA {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yFxJwRrA" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5c2b3a-286f-41dc-82f6-1f4e3ccc9717]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yFxJwRrA'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c58bd2-27c3-4c0e-9ded-07439fe44946]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a43924e-1892-499e-8863-6dc59f572a09]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:13:15 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:13:15 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:13:15 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:13:15 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:13:15 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:13:15 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.153s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] HCTL ('35', '0', '0', 0) found on session 32 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[896dd543-45cd-4b50-a13f-3fcfa31b3b9e]: (4, ('0 0 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Searching for a device in session 32 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFxJwRrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.179s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '26461393030353939', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461393030353939', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-172163985',display_name='tempest-ServerStableDeviceRescueTest-server-172163985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-172163985',id=30,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxSDJACbjhIkGWnGpSWRk519GgcSYyay2GRwh62lCPZ3y3CSlhufil/PY6EpBEH9m5Z7/xfEiNhrRF/EDZlo4ceaSq1ERJmh6bf4Gd00J2LXPtEt/9Dp39tyHYftpECEA==',key_name='tempest-keypair-868150660',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:09:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a70a43ea1458433fa79e23879bd176d4',ramdisk_id='',reservation_id='r-53sa0a7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-400577676',owner_user_name='tempest-ServerStableDeviceRescueTest-400577676-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:11:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c222956873d2461ba0f1400b64753f51',uuid=a651971c-b3b5-490b-b09e-6f93be59c663,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "vif_mac": "fa:16:3e:df:e2:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Converting VIF {"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "vif_mac": "fa:16:3e:df:e2:76"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:e2:76,bridge_name='br-int',has_traffic_filtering=True,id=0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4,network=Network(ae4f3eb0-0aec-4a48-934e-ac1cda89e0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5b3b2e-f9') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'pci_devices' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:13:15 user nova-compute[73254]:   <uuid>a651971c-b3b5-490b-b09e-6f93be59c663</uuid>
Aug 14 15:13:15 user nova-compute[73254]:   <name>instance-0000001e</name>
Aug 14 15:13:15 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:13:15 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:13:15 user nova-compute[73254]:   <metadata>
Aug 14 15:13:15 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:13:15 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:13:15 user nova-compute[73254]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-172163985</nova:name>
Aug 14 15:13:15 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:13:15</nova:creationTime>
Aug 14 15:13:15 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:13:15 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:13:15 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:13:15 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:13:15 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:13:15 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:13:15 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:13:15 user nova-compute[73254]:       <nova:owner>
Aug 14 15:13:15 user nova-compute[73254]:         <nova:user uuid="c222956873d2461ba0f1400b64753f51">tempest-ServerStableDeviceRescueTest-400577676-project-member</nova:user>
Aug 14 15:13:15 user nova-compute[73254]:         <nova:project uuid="a70a43ea1458433fa79e23879bd176d4">tempest-ServerStableDeviceRescueTest-400577676</nova:project>
Aug 14 15:13:15 user nova-compute[73254]:       </nova:owner>
Aug 14 15:13:15 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:13:15 user nova-compute[73254]:       <nova:ports>
Aug 14 15:13:15 user nova-compute[73254]:         <nova:port uuid="0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4">
Aug 14 15:13:15 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 15:13:15 user nova-compute[73254]:         </nova:port>
Aug 14 15:13:15 user nova-compute[73254]:       </nova:ports>
Aug 14 15:13:15 user nova-compute[73254]:     </nova:instance>
Aug 14 15:13:15 user nova-compute[73254]:   </metadata>
Aug 14 15:13:15 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:13:15 user nova-compute[73254]:     <system>
Aug 14 15:13:15 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:13:15 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:13:15 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:13:15 user nova-compute[73254]:       <entry name="serial">a651971c-b3b5-490b-b09e-6f93be59c663</entry>
Aug 14 15:13:15 user nova-compute[73254]:       <entry name="uuid">a651971c-b3b5-490b-b09e-6f93be59c663</entry>
Aug 14 15:13:15 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:13:15 user nova-compute[73254]:     </system>
Aug 14 15:13:15 user nova-compute[73254]:   </sysinfo>
Aug 14 15:13:15 user nova-compute[73254]:   <os>
Aug 14 15:13:15 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:13:15 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:13:15 user nova-compute[73254]:   </os>
Aug 14 15:13:15 user nova-compute[73254]:   <features>
Aug 14 15:13:15 user nova-compute[73254]:     <acpi/>
Aug 14 15:13:15 user nova-compute[73254]:     <apic/>
Aug 14 15:13:15 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:13:15 user nova-compute[73254]:   </features>
Aug 14 15:13:15 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:13:15 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:13:15 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:13:15 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:13:15 user nova-compute[73254]:   </clock>
Aug 14 15:13:15 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:13:15 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:13:15 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:13:15 user nova-compute[73254]:   </cpu>
Aug 14 15:13:15 user nova-compute[73254]:   <devices>
Aug 14 15:13:15 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:13:15 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:13:15 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk"/>
Aug 14 15:13:15 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:13:15 user nova-compute[73254]:     </disk>
Aug 14 15:13:15 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:13:15 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:13:15 user nova-compute[73254]:       <source dev="/dev/sdd"/>
Aug 14 15:13:15 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:13:15 user nova-compute[73254]:       <serial>cceba3b0-c8cb-40d1-92cf-9bc8d75100b1</serial>
Aug 14 15:13:15 user nova-compute[73254]:     </disk>
Aug 14 15:13:15 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:13:15 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:13:15 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.rescue"/>
Aug 14 15:13:15 user nova-compute[73254]:       <target dev="vdc" bus="virtio"/>
Aug 14 15:13:15 user nova-compute[73254]:       <boot order="1"/>
Aug 14 15:13:15 user nova-compute[73254]:     </disk>
Aug 14 15:13:15 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:13:15 user nova-compute[73254]:       <mac address="fa:16:3e:df:e2:76"/>
Aug 14 15:13:15 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:13:15 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:13:15 user nova-compute[73254]:       <target dev="tap0c5b3b2e-f9"/>
Aug 14 15:13:15 user nova-compute[73254]:     </interface>
Aug 14 15:13:15 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:13:15 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/console.log" append="off"/>
Aug 14 15:13:15 user nova-compute[73254]:     </serial>
Aug 14 15:13:15 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:13:15 user nova-compute[73254]:     <video>
Aug 14 15:13:15 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:13:15 user nova-compute[73254]:     </video>
Aug 14 15:13:15 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:13:15 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:13:15 user nova-compute[73254]:     </rng>
Aug 14 15:13:15 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:13:15 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:13:15 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:13:15 user nova-compute[73254]:     </memballoon>
Aug 14 15:13:15 user nova-compute[73254]:   </devices>
Aug 14 15:13:15 user nova-compute[73254]: </domain>
Aug 14 15:13:15 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:13:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Instance destroyed successfully.
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:13:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] No VIF found with MAC fa:16:3e:df:e2:76, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025996.6069586, 0578772b-534f-4d29-9b68-d9b691d339e0 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:13:16 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] VM Resumed (Lifecycle Event)
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:13:16 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Instance spawned successfully.
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:13:16 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025996.6083994, 0578772b-534f-4d29-9b68-d9b691d339e0 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:13:16 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] VM Started (Lifecycle Event)
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:13:16 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:13:16 user nova-compute[73254]: INFO nova.compute.manager [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Took 6.55 seconds to spawn the instance on the hypervisor.
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-9ea526ed-e09f-43f3-8786-1dd191ba0b55 req-eaaf75ed-7517-47c7-a08f-5a97289e64c3 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9ea526ed-e09f-43f3-8786-1dd191ba0b55 req-eaaf75ed-7517-47c7-a08f-5a97289e64c3 service nova] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9ea526ed-e09f-43f3-8786-1dd191ba0b55 req-eaaf75ed-7517-47c7-a08f-5a97289e64c3 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9ea526ed-e09f-43f3-8786-1dd191ba0b55 req-eaaf75ed-7517-47c7-a08f-5a97289e64c3 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-9ea526ed-e09f-43f3-8786-1dd191ba0b55 req-eaaf75ed-7517-47c7-a08f-5a97289e64c3 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] No waiting events found dispatching network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:13:16 user nova-compute[73254]: WARNING nova.compute.manager [req-9ea526ed-e09f-43f3-8786-1dd191ba0b55 req-eaaf75ed-7517-47c7-a08f-5a97289e64c3 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received unexpected event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 for instance with vm_state building and task_state spawning.
Aug 14 15:13:16 user nova-compute[73254]: INFO nova.compute.manager [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Took 7.29 seconds to build instance.
Aug 14 15:13:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ac378295-9d5f-4247-b02d-137eb8a5acb0 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "0578772b-534f-4d29-9b68-d9b691d339e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.418s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-023eaeb3-5946-4209-884b-05feac9df242 req-a4734acc-148b-4a33-9501-09b22d329f13 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-023eaeb3-5946-4209-884b-05feac9df242 req-a4734acc-148b-4a33-9501-09b22d329f13 service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-023eaeb3-5946-4209-884b-05feac9df242 req-a4734acc-148b-4a33-9501-09b22d329f13 service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-023eaeb3-5946-4209-884b-05feac9df242 req-a4734acc-148b-4a33-9501-09b22d329f13 service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-023eaeb3-5946-4209-884b-05feac9df242 req-a4734acc-148b-4a33-9501-09b22d329f13 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:13:17 user nova-compute[73254]: WARNING nova.compute.manager [req-023eaeb3-5946-4209-884b-05feac9df242 req-a4734acc-148b-4a33-9501-09b22d329f13 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state active and task_state rescuing.
Aug 14 15:13:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-b54afc73-411c-4445-89e4-9c74be00e06e req-afd95635-f108-484c-ae72-0ab79fcacedb service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b54afc73-411c-4445-89e4-9c74be00e06e req-afd95635-f108-484c-ae72-0ab79fcacedb service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b54afc73-411c-4445-89e4-9c74be00e06e req-afd95635-f108-484c-ae72-0ab79fcacedb service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b54afc73-411c-4445-89e4-9c74be00e06e req-afd95635-f108-484c-ae72-0ab79fcacedb service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-b54afc73-411c-4445-89e4-9c74be00e06e req-afd95635-f108-484c-ae72-0ab79fcacedb service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:13:19 user nova-compute[73254]: WARNING nova.compute.manager [req-b54afc73-411c-4445-89e4-9c74be00e06e req-afd95635-f108-484c-ae72-0ab79fcacedb service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state active and task_state rescuing.
Aug 14 15:13:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for a651971c-b3b5-490b-b09e-6f93be59c663 due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:13:19 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025999.5777307, a651971c-b3b5-490b-b09e-6f93be59c663 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:13:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] VM Resumed (Lifecycle Event)
Aug 14 15:13:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1f53fe15-6bfe-490e-9eb9-f988e548a9f9 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:13:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:13:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:13:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 15:13:19 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692025999.579966, a651971c-b3b5-490b-b09e-6f93be59c663 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:13:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] VM Started (Lifecycle Event)
Aug 14 15:13:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:13:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-c25a689c-007f-4ab6-962d-103d5350af96 req-39730f15-06dd-4dcc-ba5a-b2a630471274 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-changed-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-c25a689c-007f-4ab6-962d-103d5350af96 req-39730f15-06dd-4dcc-ba5a-b2a630471274 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Refreshing instance network info cache due to event network-changed-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c25a689c-007f-4ab6-962d-103d5350af96 req-39730f15-06dd-4dcc-ba5a-b2a630471274 service nova] Acquiring lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c25a689c-007f-4ab6-962d-103d5350af96 req-39730f15-06dd-4dcc-ba5a-b2a630471274 service nova] Acquired lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG nova.network.neutron [req-c25a689c-007f-4ab6-962d-103d5350af96 req-39730f15-06dd-4dcc-ba5a-b2a630471274 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Refreshing network info cache for port 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'flavor' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:20 user nova-compute[73254]: INFO nova.compute.manager [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Attaching volume 2212a67c-66bc-4216-878d-ecaf6e4e10ba to /dev/vdb
Aug 14 15:13:20 user nova-compute[73254]: DEBUG os_brick.utils [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaa5b10-2214-42a7-ac41-069f20e71a72]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[be28ca00-1855-4337-ace0-fce1f49da8c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fded7b-d741-479c-8566-78d5f1f42b76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b0b8c3-8ce5-4839-9e8e-1708e162a637]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:13:21 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:13:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a445ebf3-e541-4da8-a485-4742eb053b52]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG os_brick.utils [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] <== get_connector_properties: return (309ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating existing volume attachment record: 2d2c4df7-e842-4ee4-9233-e63de1a7f8dd {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG nova.network.neutron [req-c25a689c-007f-4ab6-962d-103d5350af96 req-39730f15-06dd-4dcc-ba5a-b2a630471274 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updated VIF entry in instance network info cache for port 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG nova.network.neutron [req-c25a689c-007f-4ab6-962d-103d5350af96 req-39730f15-06dd-4dcc-ba5a-b2a630471274 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating instance_info_cache with network_info: [{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:13:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c25a689c-007f-4ab6-962d-103d5350af96 req-39730f15-06dd-4dcc-ba5a-b2a630471274 service nova] Releasing lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:13:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCWVUDgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:13:30 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:13:30 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:13:30 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:13:30 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:13:30 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:13:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5515cb-b82c-42aa-8bff-edd1fcdcfdda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:13:30 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[61931530-c9b9-4e25-98b2-c28c2273b686]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba] added
Aug 14 15:13:30 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.047s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[042db18e-6e9d-4363-a6d7-f4b971790267]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.084s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ea258b-6bbd-494f-bdde-cdf7ea4cf488]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCWVUDgE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OCWVUDgE" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3923a3-f729-414e-b324-deff2f083836]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OCWVUDgE'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f645f8b-9bcb-4661-aa6c-3dd1f9c4e2a0]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[147e57bf-3f2b-45b9-9fec-1823544e7fdc]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:13:31 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:13:31 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:13:31 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:13:31 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:13:31 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:13:31 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d95f86-ae4d-4217-b0d4-45cd0a04afab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba, portal: 172.16.0.220,3260]
Aug 14 15:13:31 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba, portal: 172.16.0.220,3260] successful.
Aug 14 15:13:31 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[982218cc-153f-4561-8a62-63a47a0a2d28]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0b6b87-8b3d-439c-8549-69fbc32d54e0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:13:31 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:13:31 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:13:31 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:13:31 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:13:31 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:13:31 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:13:31 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:13:31 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ef2685-159a-4a84-a389-bc3c99a17ed1]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:13:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCWVUDgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.432s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] <== connect_volume: return (1433ms) {'type': 'block', 'scsi_wwn': '26433373162623465', 'path': '/dev/sde'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433373162623465', 'path': '/dev/sde'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'flavor' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:13:32 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:13:32 user nova-compute[73254]:   <source dev="/dev/sde"/>
Aug 14 15:13:32 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:13:32 user nova-compute[73254]:   <serial>2212a67c-66bc-4216-878d-ecaf6e4e10ba</serial>
Aug 14 15:13:32 user nova-compute[73254]: </disk>
Aug 14 15:13:32 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No VIF found with MAC fa:16:3e:2e:a6:b7, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c0c8690e-9029-43b5-9f30-58534c9a4dd5 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.066s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:34 user nova-compute[73254]: INFO nova.compute.manager [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Rescuing
Aug 14 15:13:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:13:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquired lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:13:34 user nova-compute[73254]: DEBUG nova.network.neutron [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:13:34 user nova-compute[73254]: DEBUG nova.network.neutron [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating instance_info_cache with network_info: [{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:13:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Releasing lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:13:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-5bdc5326-fb93-4ea1-a6b5-dbef5eef7369 req-322a2c58-0c01-49df-a71d-469bccda3285 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-unplugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5bdc5326-fb93-4ea1-a6b5-dbef5eef7369 req-322a2c58-0c01-49df-a71d-469bccda3285 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5bdc5326-fb93-4ea1-a6b5-dbef5eef7369 req-322a2c58-0c01-49df-a71d-469bccda3285 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5bdc5326-fb93-4ea1-a6b5-dbef5eef7369 req-322a2c58-0c01-49df-a71d-469bccda3285 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-5bdc5326-fb93-4ea1-a6b5-dbef5eef7369 req-322a2c58-0c01-49df-a71d-469bccda3285 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-unplugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:13:35 user nova-compute[73254]: WARNING nova.compute.manager [req-5bdc5326-fb93-4ea1-a6b5-dbef5eef7369 req-322a2c58-0c01-49df-a71d-469bccda3285 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-unplugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state active and task_state rescuing.
Aug 14 15:13:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Instance destroyed successfully.
Aug 14 15:13:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Attempting rescue
Aug 14 15:13:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73254) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Instance directory exists: not creating {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 15:13:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Creating image(s)
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG nova.objects.instance [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'trusted_certs' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue" returned: 0 in 0.073s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:35 user nova-compute[73254]: DEBUG nova.objects.instance [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'migration_context' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Start _get_guest_xml network_info=[{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "vif_mac": "fa:16:3e:2e:a6:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.objects.instance [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'resources' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.objects.instance [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'numa_topology' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:36 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:13:36 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.objects.instance [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1127561786',display_name='tempest-ServerRescueNegativeTestJSON-server-1127561786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1127561786',id=32,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ01/enepWJq3H3SausIfGJeo9LJ/hhZa7U3U1wVIQCfY1rxWTtqM3d/PbPlfrZ1LO6IxUwIFKF3OZDo8ZPQjPuy+785ttYLlFxHYREQN/0eurbTclXoLGCA9t9pZC0nw==',key_name='tempest-keypair-1666366664',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:11:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-gc5pb6d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:11:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5200b421cc6c4e45b91f547888fb896a',uuid=ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "vif_mac": "fa:16:3e:2e:a6:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "vif_mac": "fa:16:3e:2e:a6:b7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:a6:b7,bridge_name='br-int',has_traffic_filtering=True,id=94e5c6ae-a805-4ec4-b673-11aafe7f9c8d,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e5c6ae-a8') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.objects.instance [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'pci_devices' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:13:36 user nova-compute[73254]:   <uuid>ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e</uuid>
Aug 14 15:13:36 user nova-compute[73254]:   <name>instance-00000020</name>
Aug 14 15:13:36 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:13:36 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:13:36 user nova-compute[73254]:   <metadata>
Aug 14 15:13:36 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:13:36 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:13:36 user nova-compute[73254]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1127561786</nova:name>
Aug 14 15:13:36 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:13:36</nova:creationTime>
Aug 14 15:13:36 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:13:36 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:13:36 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:13:36 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:13:36 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:13:36 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:13:36 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:13:36 user nova-compute[73254]:       <nova:owner>
Aug 14 15:13:36 user nova-compute[73254]:         <nova:user uuid="5200b421cc6c4e45b91f547888fb896a">tempest-ServerRescueNegativeTestJSON-324663021-project-member</nova:user>
Aug 14 15:13:36 user nova-compute[73254]:         <nova:project uuid="977830faf2af42dd8be28808611d8d16">tempest-ServerRescueNegativeTestJSON-324663021</nova:project>
Aug 14 15:13:36 user nova-compute[73254]:       </nova:owner>
Aug 14 15:13:36 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:13:36 user nova-compute[73254]:       <nova:ports>
Aug 14 15:13:36 user nova-compute[73254]:         <nova:port uuid="94e5c6ae-a805-4ec4-b673-11aafe7f9c8d">
Aug 14 15:13:36 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 15:13:36 user nova-compute[73254]:         </nova:port>
Aug 14 15:13:36 user nova-compute[73254]:       </nova:ports>
Aug 14 15:13:36 user nova-compute[73254]:     </nova:instance>
Aug 14 15:13:36 user nova-compute[73254]:   </metadata>
Aug 14 15:13:36 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:13:36 user nova-compute[73254]:     <system>
Aug 14 15:13:36 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:13:36 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:13:36 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:13:36 user nova-compute[73254]:       <entry name="serial">ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e</entry>
Aug 14 15:13:36 user nova-compute[73254]:       <entry name="uuid">ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e</entry>
Aug 14 15:13:36 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:13:36 user nova-compute[73254]:     </system>
Aug 14 15:13:36 user nova-compute[73254]:   </sysinfo>
Aug 14 15:13:36 user nova-compute[73254]:   <os>
Aug 14 15:13:36 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:13:36 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:13:36 user nova-compute[73254]:   </os>
Aug 14 15:13:36 user nova-compute[73254]:   <features>
Aug 14 15:13:36 user nova-compute[73254]:     <acpi/>
Aug 14 15:13:36 user nova-compute[73254]:     <apic/>
Aug 14 15:13:36 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:13:36 user nova-compute[73254]:   </features>
Aug 14 15:13:36 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:13:36 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:13:36 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:13:36 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:13:36 user nova-compute[73254]:   </clock>
Aug 14 15:13:36 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:13:36 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:13:36 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:13:36 user nova-compute[73254]:   </cpu>
Aug 14 15:13:36 user nova-compute[73254]:   <devices>
Aug 14 15:13:36 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:13:36 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:13:36 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue"/>
Aug 14 15:13:36 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:13:36 user nova-compute[73254]:     </disk>
Aug 14 15:13:36 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:13:36 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:13:36 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk"/>
Aug 14 15:13:36 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:13:36 user nova-compute[73254]:     </disk>
Aug 14 15:13:36 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:13:36 user nova-compute[73254]:       <mac address="fa:16:3e:2e:a6:b7"/>
Aug 14 15:13:36 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:13:36 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:13:36 user nova-compute[73254]:       <target dev="tap94e5c6ae-a8"/>
Aug 14 15:13:36 user nova-compute[73254]:     </interface>
Aug 14 15:13:36 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:13:36 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/console.log" append="off"/>
Aug 14 15:13:36 user nova-compute[73254]:     </serial>
Aug 14 15:13:36 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:13:36 user nova-compute[73254]:     <video>
Aug 14 15:13:36 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:13:36 user nova-compute[73254]:     </video>
Aug 14 15:13:36 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:13:36 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:13:36 user nova-compute[73254]:     </rng>
Aug 14 15:13:36 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:13:36 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:13:36 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:13:36 user nova-compute[73254]:     </memballoon>
Aug 14 15:13:36 user nova-compute[73254]:   </devices>
Aug 14 15:13:36 user nova-compute[73254]: </domain>
Aug 14 15:13:36 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:13:36 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Instance destroyed successfully.
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:13:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] No VIF found with MAC fa:16:3e:2e:a6:b7, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-3b585527-1d2e-443f-8cbd-0965ab22a4aa req-cb5714c3-6d5c-4059-9481-e641adaf51e6 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3b585527-1d2e-443f-8cbd-0965ab22a4aa req-cb5714c3-6d5c-4059-9481-e641adaf51e6 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3b585527-1d2e-443f-8cbd-0965ab22a4aa req-cb5714c3-6d5c-4059-9481-e641adaf51e6 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3b585527-1d2e-443f-8cbd-0965ab22a4aa req-cb5714c3-6d5c-4059-9481-e641adaf51e6 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-3b585527-1d2e-443f-8cbd-0965ab22a4aa req-cb5714c3-6d5c-4059-9481-e641adaf51e6 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:13:37 user nova-compute[73254]: WARNING nova.compute.manager [req-3b585527-1d2e-443f-8cbd-0965ab22a4aa req-cb5714c3-6d5c-4059-9481-e641adaf51e6 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state active and task_state rescuing.
Aug 14 15:13:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:13:39 user nova-compute[73254]: WARNING nova.compute.manager [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state active and task_state rescuing.
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:13:39 user nova-compute[73254]: WARNING nova.compute.manager [req-41989bd8-76f8-41d2-af35-326998fd8963 req-a2b96757-f15e-411f-81e5-2d645d7d8d52 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state active and task_state rescuing.
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026019.7850232, ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:13:39 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] VM Resumed (Lifecycle Event)
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-70826792-d533-483a-a2c0-7f7beb978a87 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:13:39 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026019.7866828, ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:13:39 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] VM Started (Lifecycle Event)
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:13:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:13:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a432bff-2936-4b71-ae84-cfe9588b7677 req-aaaee0c9-1de7-4a97-bf77-ffaf09e850ad service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received event network-changed-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:13:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-6a432bff-2936-4b71-ae84-cfe9588b7677 req-aaaee0c9-1de7-4a97-bf77-ffaf09e850ad service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Refreshing instance network info cache due to event network-changed-88db0d3f-4498-4bdf-97ef-d1a510af6302. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:13:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a432bff-2936-4b71-ae84-cfe9588b7677 req-aaaee0c9-1de7-4a97-bf77-ffaf09e850ad service nova] Acquiring lock "refresh_cache-0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:13:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a432bff-2936-4b71-ae84-cfe9588b7677 req-aaaee0c9-1de7-4a97-bf77-ffaf09e850ad service nova] Acquired lock "refresh_cache-0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:13:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-6a432bff-2936-4b71-ae84-cfe9588b7677 req-aaaee0c9-1de7-4a97-bf77-ffaf09e850ad service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Refreshing network info cache for port 88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:13:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-6a432bff-2936-4b71-ae84-cfe9588b7677 req-aaaee0c9-1de7-4a97-bf77-ffaf09e850ad service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Updated VIF entry in instance network info cache for port 88db0d3f-4498-4bdf-97ef-d1a510af6302. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:13:47 user nova-compute[73254]: DEBUG nova.network.neutron [req-6a432bff-2936-4b71-ae84-cfe9588b7677 req-aaaee0c9-1de7-4a97-bf77-ffaf09e850ad service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Updating instance_info_cache with network_info: [{"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:13:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6a432bff-2936-4b71-ae84-cfe9588b7677 req-aaaee0c9-1de7-4a97-bf77-ffaf09e850ad service nova] Releasing lock "refresh_cache-0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'flavor' on Instance uuid 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:13:52 user nova-compute[73254]: INFO nova.compute.manager [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Attaching volume be7247ec-d120-463b-af70-1676ba90e50a to /dev/vdb
Aug 14 15:13:52 user nova-compute[73254]: DEBUG os_brick.utils [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ed3e2-3dcb-4288-b22b-90f5fa5373da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee89e09b-9bd2-472d-bf61-366899c4c937]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[24981d1f-af33-4f4e-9dba-05f63b851e63]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[78be1d80-b3c0-4e8b-9989-f852b7b85cbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:13:52 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:13:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55bb213-ba74-450f-aec2-cec989c6eb84]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG os_brick.utils [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Updating existing volume attachment record: 085c6716-daaa-4c1c-8b23-d0cb4397d9ac {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:13:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:13:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:59 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:13:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lhrinHwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:14:02 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:14:02 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:14:02 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6629f9-4019-4ea9-a84e-e5d950c4e184]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:14:02 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ff705a-2df0-4bf5-a81f-dc9e0e8b4966]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a] added
Aug 14 15:14:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6174b335-9e3e-4f6f-97fc-267259a94f52]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e30048-e300-4dcd-80dd-f642d7bf93ad]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lhrinHwN {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lhrinHwN" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c67bce7-b29a-471e-8e10-3ed60a09640d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lhrinHwN'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06ec25b-40f2-4521-aa42-4b0644c37816]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0413ce-ed76-4a87-8384-d106ac7d96b3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:14:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:14:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[373fc560-1412-4576-bc0b-9357c5464ddd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a, portal: 172.16.0.220,3260]
Aug 14 15:14:02 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a, portal: 172.16.0.220,3260] successful.
Aug 14 15:14:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7482aef7-3e19-4e0a-aeb9-bc09a2c2341d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e092be-e470-4cd2-ba43-f291d3cc1365]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a (non-flash)
Aug 14 15:14:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:14:02 user nova-compute[73254]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a (non-flash)
Aug 14 15:14:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] HCTL ('37', '-', '-', 0) found on session 34 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[124a09ad-51f7-4661-a7f5-64140249209b]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching for a device in session 34 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lhrinHwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:14:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:14:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23764636437633634', 'path': '/dev/sdf'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:14:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764636437633634', 'path': '/dev/sdf'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:14:03 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'flavor' on Instance uuid 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:14:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:14:03 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:14:03 user nova-compute[73254]:   <source dev="/dev/sdf"/>
Aug 14 15:14:03 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:14:03 user nova-compute[73254]:   <serial>be7247ec-d120-463b-af70-1676ba90e50a</serial>
Aug 14 15:14:03 user nova-compute[73254]: </disk>
Aug 14 15:14:03 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:14:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:03 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No VIF found with MAC fa:16:3e:c6:25:75, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e6868d31-73ca-40f7-a19c-6fb66b165d58 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.776s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: INFO nova.compute.manager [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Detaching volume be7247ec-d120-463b-af70-1676ba90e50a
Aug 14 15:14:05 user nova-compute[73254]: INFO nova.virt.block_device [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Attempting to driver detach volume be7247ec-d120-463b-af70-1676ba90e50a from mountpoint /dev/vdb
Aug 14 15:14:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Attempting to detach device vdb from instance 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:14:05 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:14:05 user nova-compute[73254]:   <source dev="/dev/sdf"/>
Aug 14 15:14:05 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:14:05 user nova-compute[73254]:   <serial>be7247ec-d120-463b-af70-1676ba90e50a</serial>
Aug 14 15:14:05 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:14:05 user nova-compute[73254]: </disk>
Aug 14 15:14:05 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:14:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully detached device vdb from instance 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 from the persistent domain config.
Aug 14 15:14:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:14:05 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:14:05 user nova-compute[73254]:   <source dev="/dev/sdf"/>
Aug 14 15:14:05 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:14:05 user nova-compute[73254]:   <serial>be7247ec-d120-463b-af70-1676ba90e50a</serial>
Aug 14 15:14:05 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:14:05 user nova-compute[73254]: </disk>
Aug 14 15:14:05 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026045.539415, 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:14:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully detached device vdb from instance 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 from the live domain config.
Aug 14 15:14:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lhrinHwN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:14:05 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8830522-5a13-40d7-a611-c3e9b819c978]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d793aa5-5e0d-4118-9e84-4c963cc92652]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:14:05 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:14:05 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:14:05 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:14:05 user nova-compute[73254]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a (non-flash)
Aug 14 15:14:05 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:14:05 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:14:05 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:14:05 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:14:05 user nova-compute[73254]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a (non-flash)
Aug 14 15:14:05 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648688550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a'): ({'sdf'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Removing single pathed devices sdf {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d42f4d9-0dae-4a49-b28f-9783336bf74d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd92204c-6cba-45b2-b22c-e1df7dc19862]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flushing IO for device /dev/sdf {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d84c62-b8ac-4aa2-a510-2195cd62193e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e127b55-34c4-4a66-b2dd-33c6f3fb4287]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] SCSI volumes sdf have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a52fd418-e486-43b0-a1be-32f77e110ca4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ba693-0c74-4f87-bc77-144a092e2ec4]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a, portal: 172.16.0.220,3260]
Aug 14 15:14:05 user nova-compute[73254]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a, portal: 172.16.0.220,3260] successful.
Aug 14 15:14:05 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:be7247ec-d120-463b-af70-1676ba90e50a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ac56ff-7540-44f7-9e5b-0b6dde4bcf13]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] <== disconnect_volume: return (354ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:06 user nova-compute[73254]: INFO nova.compute.manager [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Detaching volume b9073505-3a20-4398-8a64-3cbf36e4984f
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG nova.objects.instance [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'flavor' on Instance uuid 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:14:06 user nova-compute[73254]: INFO nova.virt.block_device [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Attempting to driver detach volume b9073505-3a20-4398-8a64-3cbf36e4984f from mountpoint /dev/vdb
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-cd3a0497-1fba-4dd5-b095-618bcd739396 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.976s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Attempting to detach device vdb from instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:14:06 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:14:06 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:14:06 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:14:06 user nova-compute[73254]:   <serial>b9073505-3a20-4398-8a64-3cbf36e4984f</serial>
Aug 14 15:14:06 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 15:14:06 user nova-compute[73254]: </disk>
Aug 14 15:14:06 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:14:06 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully detached device vdb from instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 from the persistent domain config.
Aug 14 15:14:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:14:06 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:14:06 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:14:06 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:14:06 user nova-compute[73254]:   <serial>b9073505-3a20-4398-8a64-3cbf36e4984f</serial>
Aug 14 15:14:06 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 15:14:06 user nova-compute[73254]: </disk>
Aug 14 15:14:06 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026047.3885522, 99c570f9-25b2-4a7f-93b1-6669bc58cb97 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:14:07 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully detached device vdb from instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 from the live domain config.
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vzCuAYMy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:14:07 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e629cc8-a977-4975-815a-86b2e412e30a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f19dcf-8036-4b6b-844f-ecdb5cacf59d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:14:07 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:14:07 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:14:07 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:14:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:14:07 user nova-compute[73254]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f (non-flash)
Aug 14 15:14:07 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:14:07 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:14:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd693fd8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee114c3-0d73-4037-9ae9-8469211844be]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[74039bb4-83ea-462b-9ae4-8f6c81cae3b0]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fc1440-3317-4c71-ae7e-53b7e37ba33b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eece192d-451b-49eb-8d88-179218264137]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a788cdf2-8dfc-429f-872c-615c4636e0b4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dc2d15-c2a6-415c-8b14-314c985bbb8f]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260]
Aug 14 15:14:07 user nova-compute[73254]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f, portal: 172.16.0.220,3260] successful.
Aug 14 15:14:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9073505-3a20-4398-8a64-3cbf36e4984f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a936af15-eeb9-417f-a697-8a21818399af]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== disconnect_volume: return (304ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:08 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'flavor' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:14:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b850f105-d663-4352-a630-28a137f65a42 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.912s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:09 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:14:09 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7472MB free_disk=24.947784423828125GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a651971c-b3b5-490b-b09e-6f93be59c663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0578772b-534f-4d29-9b68-d9b691d339e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:14:09 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:14:10 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:14:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:14:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:14:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.858s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:14:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:14:13 user nova-compute[73254]: INFO nova.compute.claims [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Claim successful on node user
Aug 14 15:14:13 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:14:13 user nova-compute[73254]: DEBUG nova.network.neutron [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:14:14 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:14:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG nova.policy [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c372e49b3d04765aa35916ba8e2e0f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d51019cbe3a4ce694c44fd294c26e76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:14:14 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Creating image(s)
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "/opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "/opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "/opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Updating instance_info_cache with network_info: [{"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk 1073741824" returned: 0 in 0.046s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Cannot resize image /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:14:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'migration_context' on Instance uuid 0efd0626-539e-4e61-b537-bff7479417b0 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:14:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:14:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Ensure instance console log exists: /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:14:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Successfully created port: 54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Successfully updated port: 54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "refresh_cache-0efd0626-539e-4e61-b537-bff7479417b0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquired lock "refresh_cache-0efd0626-539e-4e61-b537-bff7479417b0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-6e7b9fa7-b628-4b45-9cf1-4ece8c21fad1 req-b5709d2a-d24a-427e-82c0-a2a2bca47237 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received event network-changed-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-6e7b9fa7-b628-4b45-9cf1-4ece8c21fad1 req-b5709d2a-d24a-427e-82c0-a2a2bca47237 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Refreshing instance network info cache due to event network-changed-54fe67d2-0344-4060-b0ec-c6dcc210f1df. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6e7b9fa7-b628-4b45-9cf1-4ece8c21fad1 req-b5709d2a-d24a-427e-82c0-a2a2bca47237 service nova] Acquiring lock "refresh_cache-0efd0626-539e-4e61-b537-bff7479417b0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Updating instance_info_cache with network_info: [{"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Releasing lock "refresh_cache-0efd0626-539e-4e61-b537-bff7479417b0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Instance network_info: |[{"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6e7b9fa7-b628-4b45-9cf1-4ece8c21fad1 req-b5709d2a-d24a-427e-82c0-a2a2bca47237 service nova] Acquired lock "refresh_cache-0efd0626-539e-4e61-b537-bff7479417b0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.network.neutron [req-6e7b9fa7-b628-4b45-9cf1-4ece8c21fad1 req-b5709d2a-d24a-427e-82c0-a2a2bca47237 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Refreshing network info cache for port 54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Start _get_guest_xml network_info=[{"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:14:16 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:14:16 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-29855895',display_name='tempest-VolumesSnapshotTestJSON-instance-29855895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-29855895',id=35,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi8D7bplxLaCd9hJw4AnP4B2VmyGyEpX8WojL4HpYOcJ1dQthzCI6DBW+xuM+RuAIWbBASOk8KaO5wOW/pGkObrENBQVWf0pNYCg0ZFArHjUNkYsvLxaH9Ar6xeJg+dCg==',key_name='tempest-keypair-310070889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d51019cbe3a4ce694c44fd294c26e76',ramdisk_id='',reservation_id='r-rlvf1xn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1785106285',owner_user_name='tempest-VolumesSnapshotTestJSON-1785106285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c372e49b3d04765aa35916ba8e2e0f8',uuid=0efd0626-539e-4e61-b537-bff7479417b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converting VIF {"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fe:4b,bridge_name='br-int',has_traffic_filtering=True,id=54fe67d2-0344-4060-b0ec-c6dcc210f1df,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fe67d2-03') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'pci_devices' on Instance uuid 0efd0626-539e-4e61-b537-bff7479417b0 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:14:16 user nova-compute[73254]:   <uuid>0efd0626-539e-4e61-b537-bff7479417b0</uuid>
Aug 14 15:14:16 user nova-compute[73254]:   <name>instance-00000023</name>
Aug 14 15:14:16 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:14:16 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:14:16 user nova-compute[73254]:   <metadata>
Aug 14 15:14:16 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:14:16 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:14:16 user nova-compute[73254]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-29855895</nova:name>
Aug 14 15:14:16 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:14:16</nova:creationTime>
Aug 14 15:14:16 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:14:16 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:14:16 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:14:16 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:14:16 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:14:16 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:14:16 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:14:16 user nova-compute[73254]:       <nova:owner>
Aug 14 15:14:16 user nova-compute[73254]:         <nova:user uuid="9c372e49b3d04765aa35916ba8e2e0f8">tempest-VolumesSnapshotTestJSON-1785106285-project-member</nova:user>
Aug 14 15:14:16 user nova-compute[73254]:         <nova:project uuid="3d51019cbe3a4ce694c44fd294c26e76">tempest-VolumesSnapshotTestJSON-1785106285</nova:project>
Aug 14 15:14:16 user nova-compute[73254]:       </nova:owner>
Aug 14 15:14:16 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:14:16 user nova-compute[73254]:       <nova:ports>
Aug 14 15:14:16 user nova-compute[73254]:         <nova:port uuid="54fe67d2-0344-4060-b0ec-c6dcc210f1df">
Aug 14 15:14:16 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 15:14:16 user nova-compute[73254]:         </nova:port>
Aug 14 15:14:16 user nova-compute[73254]:       </nova:ports>
Aug 14 15:14:16 user nova-compute[73254]:     </nova:instance>
Aug 14 15:14:16 user nova-compute[73254]:   </metadata>
Aug 14 15:14:16 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:14:16 user nova-compute[73254]:     <system>
Aug 14 15:14:16 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:14:16 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:14:16 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:14:16 user nova-compute[73254]:       <entry name="serial">0efd0626-539e-4e61-b537-bff7479417b0</entry>
Aug 14 15:14:16 user nova-compute[73254]:       <entry name="uuid">0efd0626-539e-4e61-b537-bff7479417b0</entry>
Aug 14 15:14:16 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:14:16 user nova-compute[73254]:     </system>
Aug 14 15:14:16 user nova-compute[73254]:   </sysinfo>
Aug 14 15:14:16 user nova-compute[73254]:   <os>
Aug 14 15:14:16 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:14:16 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:14:16 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:14:16 user nova-compute[73254]:   </os>
Aug 14 15:14:16 user nova-compute[73254]:   <features>
Aug 14 15:14:16 user nova-compute[73254]:     <acpi/>
Aug 14 15:14:16 user nova-compute[73254]:     <apic/>
Aug 14 15:14:16 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:14:16 user nova-compute[73254]:   </features>
Aug 14 15:14:16 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:14:16 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:14:16 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:14:16 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:14:16 user nova-compute[73254]:   </clock>
Aug 14 15:14:16 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:14:16 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:14:16 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:14:16 user nova-compute[73254]:   </cpu>
Aug 14 15:14:16 user nova-compute[73254]:   <devices>
Aug 14 15:14:16 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:14:16 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:14:16 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk"/>
Aug 14 15:14:16 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:14:16 user nova-compute[73254]:     </disk>
Aug 14 15:14:16 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:14:16 user nova-compute[73254]:       <mac address="fa:16:3e:32:fe:4b"/>
Aug 14 15:14:16 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:14:16 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:14:16 user nova-compute[73254]:       <target dev="tap54fe67d2-03"/>
Aug 14 15:14:16 user nova-compute[73254]:     </interface>
Aug 14 15:14:16 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:14:16 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/console.log" append="off"/>
Aug 14 15:14:16 user nova-compute[73254]:     </serial>
Aug 14 15:14:16 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:14:16 user nova-compute[73254]:     <video>
Aug 14 15:14:16 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:14:16 user nova-compute[73254]:     </video>
Aug 14 15:14:16 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:14:16 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:14:16 user nova-compute[73254]:     </rng>
Aug 14 15:14:16 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:14:16 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:14:16 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:14:16 user nova-compute[73254]:     </memballoon>
Aug 14 15:14:16 user nova-compute[73254]:   </devices>
Aug 14 15:14:16 user nova-compute[73254]: </domain>
Aug 14 15:14:16 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-29855895',display_name='tempest-VolumesSnapshotTestJSON-instance-29855895',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-29855895',id=35,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi8D7bplxLaCd9hJw4AnP4B2VmyGyEpX8WojL4HpYOcJ1dQthzCI6DBW+xuM+RuAIWbBASOk8KaO5wOW/pGkObrENBQVWf0pNYCg0ZFArHjUNkYsvLxaH9Ar6xeJg+dCg==',key_name='tempest-keypair-310070889',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d51019cbe3a4ce694c44fd294c26e76',ramdisk_id='',reservation_id='r-rlvf1xn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1785106285',owner_user_name='tempest-VolumesSnapshotTestJSON-1785106285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:14:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c372e49b3d04765aa35916ba8e2e0f8',uuid=0efd0626-539e-4e61-b537-bff7479417b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converting VIF {"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:fe:4b,bridge_name='br-int',has_traffic_filtering=True,id=54fe67d2-0344-4060-b0ec-c6dcc210f1df,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fe67d2-03') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG os_vif [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fe:4b,bridge_name='br-int',has_traffic_filtering=True,id=54fe67d2-0344-4060-b0ec-c6dcc210f1df,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fe67d2-03') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54fe67d2-03, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap54fe67d2-03, col_values=(('external_ids', {'iface-id': '54fe67d2-0344-4060-b0ec-c6dcc210f1df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:fe:4b', 'vm-uuid': '0efd0626-539e-4e61-b537-bff7479417b0'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:16 user nova-compute[73254]: INFO os_vif [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:fe:4b,bridge_name='br-int',has_traffic_filtering=True,id=54fe67d2-0344-4060-b0ec-c6dcc210f1df,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fe67d2-03')
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:14:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] No VIF found with MAC fa:16:3e:32:fe:4b, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:14:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-6e7b9fa7-b628-4b45-9cf1-4ece8c21fad1 req-b5709d2a-d24a-427e-82c0-a2a2bca47237 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Updated VIF entry in instance network info cache for port 54fe67d2-0344-4060-b0ec-c6dcc210f1df. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:14:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-6e7b9fa7-b628-4b45-9cf1-4ece8c21fad1 req-b5709d2a-d24a-427e-82c0-a2a2bca47237 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Updating instance_info_cache with network_info: [{"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:14:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6e7b9fa7-b628-4b45-9cf1-4ece8c21fad1 req-b5709d2a-d24a-427e-82c0-a2a2bca47237 service nova] Releasing lock "refresh_cache-0efd0626-539e-4e61-b537-bff7479417b0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-dee3a4d3-93d0-42f4-b3ca-9fdd1107bb64 req-86f7a39d-ba94-4d59-b5f2-14d0b6faf94c service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received event network-vif-plugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-dee3a4d3-93d0-42f4-b3ca-9fdd1107bb64 req-86f7a39d-ba94-4d59-b5f2-14d0b6faf94c service nova] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-dee3a4d3-93d0-42f4-b3ca-9fdd1107bb64 req-86f7a39d-ba94-4d59-b5f2-14d0b6faf94c service nova] Lock "0efd0626-539e-4e61-b537-bff7479417b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-dee3a4d3-93d0-42f4-b3ca-9fdd1107bb64 req-86f7a39d-ba94-4d59-b5f2-14d0b6faf94c service nova] Lock "0efd0626-539e-4e61-b537-bff7479417b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-dee3a4d3-93d0-42f4-b3ca-9fdd1107bb64 req-86f7a39d-ba94-4d59-b5f2-14d0b6faf94c service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] No waiting events found dispatching network-vif-plugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:14:18 user nova-compute[73254]: WARNING nova.compute.manager [req-dee3a4d3-93d0-42f4-b3ca-9fdd1107bb64 req-86f7a39d-ba94-4d59-b5f2-14d0b6faf94c service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received unexpected event network-vif-plugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df for instance with vm_state building and task_state spawning.
Aug 14 15:14:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026060.2843719, 0efd0626-539e-4e61-b537-bff7479417b0 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:14:20 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] VM Resumed (Lifecycle Event)
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:14:20 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Instance spawned successfully.
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:14:20 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026060.2855735, 0efd0626-539e-4e61-b537-bff7479417b0 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:14:20 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] VM Started (Lifecycle Event)
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:14:20 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:14:20 user nova-compute[73254]: INFO nova.compute.manager [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Took 6.28 seconds to spawn the instance on the hypervisor.
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-8250e761-5e27-4331-b123-414d655bf357 req-b6d08df4-693f-4590-b5c8-1d4f18a44634 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received event network-vif-plugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8250e761-5e27-4331-b123-414d655bf357 req-b6d08df4-693f-4590-b5c8-1d4f18a44634 service nova] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8250e761-5e27-4331-b123-414d655bf357 req-b6d08df4-693f-4590-b5c8-1d4f18a44634 service nova] Lock "0efd0626-539e-4e61-b537-bff7479417b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8250e761-5e27-4331-b123-414d655bf357 req-b6d08df4-693f-4590-b5c8-1d4f18a44634 service nova] Lock "0efd0626-539e-4e61-b537-bff7479417b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-8250e761-5e27-4331-b123-414d655bf357 req-b6d08df4-693f-4590-b5c8-1d4f18a44634 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] No waiting events found dispatching network-vif-plugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:14:20 user nova-compute[73254]: WARNING nova.compute.manager [req-8250e761-5e27-4331-b123-414d655bf357 req-b6d08df4-693f-4590-b5c8-1d4f18a44634 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received unexpected event network-vif-plugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df for instance with vm_state building and task_state spawning.
Aug 14 15:14:20 user nova-compute[73254]: INFO nova.compute.manager [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Took 7.14 seconds to build instance.
Aug 14 15:14:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1ec3a252-bd08-4009-b8af-1341a10e6ec9 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.245s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid c3816901-3f73-4e5c-b078-a7e78d52ef3d {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 7149269a-b4a2-4500-a426-d31dd315a369 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 0578772b-534f-4d29-9b68-d9b691d339e0 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 0efd0626-539e-4e61-b537-bff7479417b0 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "7149269a-b4a2-4500-a426-d31dd315a369" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "7149269a-b4a2-4500-a426-d31dd315a369" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "0578772b-534f-4d29-9b68-d9b691d339e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "0efd0626-539e-4e61-b537-bff7479417b0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "7149269a-b4a2-4500-a426-d31dd315a369" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "0578772b-534f-4d29-9b68-d9b691d339e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "0efd0626-539e-4e61-b537-bff7479417b0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:14:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:14:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:14:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:14:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:55 user nova-compute[73254]: INFO nova.compute.manager [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Terminating instance
Aug 14 15:14:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-d8d636b1-2a42-4300-bfed-e7249d9a0f04 req-ea6d2716-20d3-4da3-9ee3-34409cbfd177 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received event network-vif-unplugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d8d636b1-2a42-4300-bfed-e7249d9a0f04 req-ea6d2716-20d3-4da3-9ee3-34409cbfd177 service nova] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d8d636b1-2a42-4300-bfed-e7249d9a0f04 req-ea6d2716-20d3-4da3-9ee3-34409cbfd177 service nova] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d8d636b1-2a42-4300-bfed-e7249d9a0f04 req-ea6d2716-20d3-4da3-9ee3-34409cbfd177 service nova] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-d8d636b1-2a42-4300-bfed-e7249d9a0f04 req-ea6d2716-20d3-4da3-9ee3-34409cbfd177 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] No waiting events found dispatching network-vif-unplugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-d8d636b1-2a42-4300-bfed-e7249d9a0f04 req-ea6d2716-20d3-4da3-9ee3-34409cbfd177 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received event network-vif-unplugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:14:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Instance destroyed successfully.
Aug 14 15:14:56 user nova-compute[73254]: DEBUG nova.objects.instance [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'resources' on Instance uuid 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:14:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:11:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-934313066',display_name='tempest-AttachVolumeNegativeTest-server-934313066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-934313066',id=33,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLzh3uLdNezMQtvFvj1h98LABWVOVjNut4JKzobdKWwo4TTLKAsgtYnYekSoLFAVVCIRUaLvon8+fzWkqpXqu7InOnGw6A8gfhdOypPCs4Rs24209rJ82JVT3jzwsTajlQ==',key_name='tempest-keypair-314522417',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:12:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-905k87r2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:12:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=0fe8688c-4e52-4105-8b7b-9c59d2b66cf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:14:56 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "address": "fa:16:3e:c6:25:75", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88db0d3f-44", "ovs_interfaceid": "88db0d3f-4498-4bdf-97ef-d1a510af6302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:14:56 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:25:75,bridge_name='br-int',has_traffic_filtering=True,id=88db0d3f-4498-4bdf-97ef-d1a510af6302,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db0d3f-44') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:14:56 user nova-compute[73254]: DEBUG os_vif [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:25:75,bridge_name='br-int',has_traffic_filtering=True,id=88db0d3f-4498-4bdf-97ef-d1a510af6302,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db0d3f-44') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:14:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88db0d3f-44, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:14:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:56 user nova-compute[73254]: INFO os_vif [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:25:75,bridge_name='br-int',has_traffic_filtering=True,id=88db0d3f-4498-4bdf-97ef-d1a510af6302,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88db0d3f-44')
Aug 14 15:14:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Deleting instance files /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8_del
Aug 14 15:14:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Deletion of /opt/stack/data/nova/instances/0fe8688c-4e52-4105-8b7b-9c59d2b66cf8_del complete
Aug 14 15:14:56 user nova-compute[73254]: INFO nova.compute.manager [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 15:14:56 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:14:56 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:14:56 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:14:57 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Took 0.89 seconds to deallocate network for instance.
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:57 user nova-compute[73254]: INFO nova.compute.manager [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Terminating instance
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:57 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Deleted allocations for instance 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received event network-vif-plugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] Acquiring lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] No waiting events found dispatching network-vif-plugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:14:57 user nova-compute[73254]: WARNING nova.compute.manager [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received unexpected event network-vif-plugged-88db0d3f-4498-4bdf-97ef-d1a510af6302 for instance with vm_state deleted and task_state None.
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Received event network-vif-deleted-88db0d3f-4498-4bdf-97ef-d1a510af6302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-vif-unplugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] No waiting events found dispatching network-vif-unplugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-vif-unplugged-30118178-a209-428b-a649-a9ebf6ef2b39 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] Acquiring lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] No waiting events found dispatching network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:14:57 user nova-compute[73254]: WARNING nova.compute.manager [req-52220120-20e8-4fe5-bc43-5404d77cfb83 req-a4c6455b-1a8e-4d43-9289-0b60bc81a027 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received unexpected event network-vif-plugged-30118178-a209-428b-a649-a9ebf6ef2b39 for instance with vm_state active and task_state deleting.
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-76a628e0-a589-456d-b57d-49cca2da2719 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "0fe8688c-4e52-4105-8b7b-9c59d2b66cf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.432s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Instance destroyed successfully.
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.objects.instance [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'resources' on Instance uuid 99c570f9-25b2-4a7f-93b1-6669bc58cb97 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T15:09:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-820172951',display_name='tempest-ServerActionsTestOtherA-server-1335560451',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-820172951',id=29,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxweWbtJ3snXy8ZVLWJCwG56uXS2DyyqnyaiR5jWZGSkKXxPeOvERhjeuEaq12DhRmHFNgnz7fxy604iqewq01HbXKz2UIKeLGLTXTuDmGJW7zOnPqkKRm/I8wKCjvavg==',key_name='tempest-keypair-1364011075',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:11:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-fk0uij6u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:11:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=99c570f9-25b2-4a7f-93b1-6669bc58cb97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "30118178-a209-428b-a649-a9ebf6ef2b39", "address": "fa:16:3e:c6:04:a3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.193", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30118178-a2", "ovs_interfaceid": "30118178-a209-428b-a649-a9ebf6ef2b39", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG os_vif [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30118178-a2, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:14:57 user nova-compute[73254]: INFO os_vif [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:04:a3,bridge_name='br-int',has_traffic_filtering=True,id=30118178-a209-428b-a649-a9ebf6ef2b39,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30118178-a2')
Aug 14 15:14:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Deleting instance files /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97_del
Aug 14 15:14:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Deletion of /opt/stack/data/nova/instances/99c570f9-25b2-4a7f-93b1-6669bc58cb97_del complete
Aug 14 15:14:57 user nova-compute[73254]: INFO nova.compute.manager [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 15:14:57 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:14:57 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:14:58 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:14:58 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Took 0.88 seconds to deallocate network for instance.
Aug 14 15:14:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:14:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:14:59 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:14:59 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:14:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:59 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Deleted allocations for instance 99c570f9-25b2-4a7f-93b1-6669bc58cb97
Aug 14 15:14:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-98aec17f-b0f9-4dcd-8c75-bbbf13413da0 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "99c570f9-25b2-4a7f-93b1-6669bc58cb97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.271s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:14:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-d655fb44-5a90-45ef-9351-70ff1a3a3aad req-ae6173c6-f7cb-46af-b76c-1065f40d3181 service nova] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Received event network-vif-deleted-30118178-a209-428b-a649-a9ebf6ef2b39 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:00 user nova-compute[73254]: DEBUG nova.compute.manager [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:00 user nova-compute[73254]: INFO nova.compute.manager [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] instance snapshotting
Aug 14 15:15:00 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Beginning live snapshot process
Aug 14 15:15:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json -f qcow2 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json -f qcow2" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json -f qcow2 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz0i2sd8m/264ddd436cb54d23a149a1d7c31f8c93.delta 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpz0i2sd8m/264ddd436cb54d23a149a1d7c31f8c93.delta 1073741824" returned: 0 in 0.057s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:01 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 14 15:15:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73254) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 15:15:02 user nova-compute[73254]: INFO nova.compute.manager [None req-14ba51e9-2290-4ed0-8d18-1c128ac05d36 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Unrescuing
Aug 14 15:15:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-14ba51e9-2290-4ed0-8d18-1c128ac05d36 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:15:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-14ba51e9-2290-4ed0-8d18-1c128ac05d36 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquired lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:15:02 user nova-compute[73254]: DEBUG nova.network.neutron [None req-14ba51e9-2290-4ed0-8d18-1c128ac05d36 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:15:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73254) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 14 15:15:02 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 14 15:15:02 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:15:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz0i2sd8m/264ddd436cb54d23a149a1d7c31f8c93.delta /opt/stack/data/nova/instances/snapshots/tmpz0i2sd8m/264ddd436cb54d23a149a1d7c31f8c93 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG nova.network.neutron [None req-14ba51e9-2290-4ed0-8d18-1c128ac05d36 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updating instance_info_cache with network_info: [{"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-14ba51e9-2290-4ed0-8d18-1c128ac05d36 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Releasing lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG nova.objects.instance [None req-14ba51e9-2290-4ed0-8d18-1c128ac05d36 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'flavor' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpz0i2sd8m/264ddd436cb54d23a149a1d7c31f8c93.delta /opt/stack/data/nova/instances/snapshots/tmpz0i2sd8m/264ddd436cb54d23a149a1d7c31f8c93" returned: 0 in 0.659s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Snapshot extracted, beginning image upload
Aug 14 15:15:03 user nova-compute[73254]: DEBUG nova.compute.manager [req-471da64d-f5f7-43b6-92fc-ed5d005a4ba7 req-6ac04ac4-78a2-4ca9-874b-1d7b841d196c service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-unplugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-471da64d-f5f7-43b6-92fc-ed5d005a4ba7 req-6ac04ac4-78a2-4ca9-874b-1d7b841d196c service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-471da64d-f5f7-43b6-92fc-ed5d005a4ba7 req-6ac04ac4-78a2-4ca9-874b-1d7b841d196c service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-471da64d-f5f7-43b6-92fc-ed5d005a4ba7 req-6ac04ac4-78a2-4ca9-874b-1d7b841d196c service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:03 user nova-compute[73254]: DEBUG nova.compute.manager [req-471da64d-f5f7-43b6-92fc-ed5d005a4ba7 req-6ac04ac4-78a2-4ca9-874b-1d7b841d196c service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-unplugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:15:03 user nova-compute[73254]: WARNING nova.compute.manager [req-471da64d-f5f7-43b6-92fc-ed5d005a4ba7 req-6ac04ac4-78a2-4ca9-874b-1d7b841d196c service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-unplugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:15:04 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Instance destroyed successfully.
Aug 14 15:15:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-8721d2b4-8d16-4076-8b2c-7f3a370760bf req-8c986a76-8577-4ebb-95ba-8833d18fc999 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-changed-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-8721d2b4-8d16-4076-8b2c-7f3a370760bf req-8c986a76-8577-4ebb-95ba-8833d18fc999 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Refreshing instance network info cache due to event network-changed-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:15:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8721d2b4-8d16-4076-8b2c-7f3a370760bf req-8c986a76-8577-4ebb-95ba-8833d18fc999 service nova] Acquiring lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:15:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8721d2b4-8d16-4076-8b2c-7f3a370760bf req-8c986a76-8577-4ebb-95ba-8833d18fc999 service nova] Acquired lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:15:04 user nova-compute[73254]: DEBUG nova.network.neutron [req-8721d2b4-8d16-4076-8b2c-7f3a370760bf req-8c986a76-8577-4ebb-95ba-8833d18fc999 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Refreshing network info cache for port 0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG nova.network.neutron [req-8721d2b4-8d16-4076-8b2c-7f3a370760bf req-8c986a76-8577-4ebb-95ba-8833d18fc999 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updated VIF entry in instance network info cache for port 0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG nova.network.neutron [req-8721d2b4-8d16-4076-8b2c-7f3a370760bf req-8c986a76-8577-4ebb-95ba-8833d18fc999 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updating instance_info_cache with network_info: [{"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8721d2b4-8d16-4076-8b2c-7f3a370760bf req-8c986a76-8577-4ebb-95ba-8833d18fc999 service nova] Releasing lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG nova.compute.manager [req-11a35245-5d09-427a-ab24-4bfcc1c8b6d6 req-1e3128f3-309f-4054-a2cd-3b9d18bff6c7 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11a35245-5d09-427a-ab24-4bfcc1c8b6d6 req-1e3128f3-309f-4054-a2cd-3b9d18bff6c7 service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11a35245-5d09-427a-ab24-4bfcc1c8b6d6 req-1e3128f3-309f-4054-a2cd-3b9d18bff6c7 service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11a35245-5d09-427a-ab24-4bfcc1c8b6d6 req-1e3128f3-309f-4054-a2cd-3b9d18bff6c7 service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:05 user nova-compute[73254]: DEBUG nova.compute.manager [req-11a35245-5d09-427a-ab24-4bfcc1c8b6d6 req-1e3128f3-309f-4054-a2cd-3b9d18bff6c7 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:15:05 user nova-compute[73254]: WARNING nova.compute.manager [req-11a35245-5d09-427a-ab24-4bfcc1c8b6d6 req-1e3128f3-309f-4054-a2cd-3b9d18bff6c7 service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:15:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-ae4d9611-b03b-4e15-9d26-015fbeeb109e req-a1622126-011b-4d27-a580-989df717b28b service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-changed-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-ae4d9611-b03b-4e15-9d26-015fbeeb109e req-a1622126-011b-4d27-a580-989df717b28b service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Refreshing instance network info cache due to event network-changed-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ae4d9611-b03b-4e15-9d26-015fbeeb109e req-a1622126-011b-4d27-a580-989df717b28b service nova] Acquiring lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ae4d9611-b03b-4e15-9d26-015fbeeb109e req-a1622126-011b-4d27-a580-989df717b28b service nova] Acquired lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-ae4d9611-b03b-4e15-9d26-015fbeeb109e req-a1622126-011b-4d27-a580-989df717b28b service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Refreshing network info cache for port 0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:06 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Snapshot image upload complete
Aug 14 15:15:06 user nova-compute[73254]: INFO nova.compute.manager [None req-095bdf07-ec8e-4aa2-b41a-b2c401c7207a tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Took 6.24 seconds to snapshot the instance on the hypervisor.
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:15:07 user nova-compute[73254]: WARNING nova.compute.manager [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:15:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:15:07 user nova-compute[73254]: WARNING nova.compute.manager [req-20e279e2-4dc1-46db-a21f-4935ecea4b87 req-794b1e09-8fe0-4bd0-9106-19bcd4436cdc service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG nova.network.neutron [req-ae4d9611-b03b-4e15-9d26-015fbeeb109e req-a1622126-011b-4d27-a580-989df717b28b service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updated VIF entry in instance network info cache for port 0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG nova.network.neutron [req-ae4d9611-b03b-4e15-9d26-015fbeeb109e req-a1622126-011b-4d27-a580-989df717b28b service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updating instance_info_cache with network_info: [{"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-ae4d9611-b03b-4e15-9d26-015fbeeb109e req-a1622126-011b-4d27-a580-989df717b28b service nova] Releasing lock "refresh_cache-a651971c-b3b5-490b-b09e-6f93be59c663" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for a651971c-b3b5-490b-b09e-6f93be59c663 due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:15:07 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026107.9924784, a651971c-b3b5-490b-b09e-6f93be59c663 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:15:07 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] VM Resumed (Lifecycle Event)
Aug 14 15:15:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-14ba51e9-2290-4ed0-8d18-1c128ac05d36 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:15:08 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 15:15:08 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026107.9927542, a651971c-b3b5-490b-b09e-6f93be59c663 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:15:08 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] VM Started (Lifecycle Event)
Aug 14 15:15:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:15:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:10 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:15:10 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7729MB free_disk=24.9072265625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a651971c-b3b5-490b-b09e-6f93be59c663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0578772b-534f-4d29-9b68-d9b691d339e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0efd0626-539e-4e61-b537-bff7479417b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:15:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:15:11 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026096.0150518, 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:15:11 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] VM Stopped (Lifecycle Event)
Aug 14 15:15:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3fd5b4a8-f44d-47a8-a9d4-ae08a46e18a4 None None] [instance: 0fe8688c-4e52-4105-8b7b-9c59d2b66cf8] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:11 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:15:11 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:15:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:15:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.588s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:12 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026097.854026, 99c570f9-25b2-4a7f-93b1-6669bc58cb97 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:15:12 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] VM Stopped (Lifecycle Event)
Aug 14 15:15:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-8990ad8e-076c-4653-96cb-a0f950e5f146 None None] [instance: 99c570f9-25b2-4a7f-93b1-6669bc58cb97] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:15:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:15:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:15:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:15:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:15:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updating instance_info_cache with network_info: [{"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:15:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:25 user nova-compute[73254]: INFO nova.compute.manager [None req-763c620b-6f6a-47fa-a956-d6edec259952 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Unrescuing
Aug 14 15:15:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763c620b-6f6a-47fa-a956-d6edec259952 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:15:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763c620b-6f6a-47fa-a956-d6edec259952 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquired lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:15:25 user nova-compute[73254]: DEBUG nova.network.neutron [None req-763c620b-6f6a-47fa-a956-d6edec259952 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:15:25 user nova-compute[73254]: DEBUG nova.network.neutron [None req-763c620b-6f6a-47fa-a956-d6edec259952 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating instance_info_cache with network_info: [{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:15:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-763c620b-6f6a-47fa-a956-d6edec259952 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Releasing lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:15:25 user nova-compute[73254]: DEBUG nova.objects.instance [None req-763c620b-6f6a-47fa-a956-d6edec259952 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'flavor' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:15:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-30df2b29-ae00-4b30-873f-0c5cd0500a58 req-08daaafe-b4cf-40e4-89a8-c1ea067ee9f9 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-unplugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-30df2b29-ae00-4b30-873f-0c5cd0500a58 req-08daaafe-b4cf-40e4-89a8-c1ea067ee9f9 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-30df2b29-ae00-4b30-873f-0c5cd0500a58 req-08daaafe-b4cf-40e4-89a8-c1ea067ee9f9 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-30df2b29-ae00-4b30-873f-0c5cd0500a58 req-08daaafe-b4cf-40e4-89a8-c1ea067ee9f9 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-30df2b29-ae00-4b30-873f-0c5cd0500a58 req-08daaafe-b4cf-40e4-89a8-c1ea067ee9f9 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-unplugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:15:26 user nova-compute[73254]: WARNING nova.compute.manager [req-30df2b29-ae00-4b30-873f-0c5cd0500a58 req-08daaafe-b4cf-40e4-89a8-c1ea067ee9f9 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-unplugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:15:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:26 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Instance destroyed successfully.
Aug 14 15:15:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:15:28 user nova-compute[73254]: WARNING nova.compute.manager [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:15:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:15:28 user nova-compute[73254]: WARNING nova.compute.manager [req-f85857d7-050a-4645-9e88-f107e445f722 req-d9ca898c-9270-45d6-89d2-9b40373285c7 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:15:29 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:15:29 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026129.7866309, ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:15:29 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] VM Resumed (Lifecycle Event)
Aug 14 15:15:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-763c620b-6f6a-47fa-a956-d6edec259952 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:15:29 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 15:15:29 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026129.7887712, ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:15:29 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] VM Started (Lifecycle Event)
Aug 14 15:15:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:15:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-7d6f8de5-172c-4dc3-9ef6-a141b6aec2b9 req-b495009c-274b-4c3f-bbb4-0039a9958d6d service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7d6f8de5-172c-4dc3-9ef6-a141b6aec2b9 req-b495009c-274b-4c3f-bbb4-0039a9958d6d service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7d6f8de5-172c-4dc3-9ef6-a141b6aec2b9 req-b495009c-274b-4c3f-bbb4-0039a9958d6d service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7d6f8de5-172c-4dc3-9ef6-a141b6aec2b9 req-b495009c-274b-4c3f-bbb4-0039a9958d6d service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-7d6f8de5-172c-4dc3-9ef6-a141b6aec2b9 req-b495009c-274b-4c3f-bbb4-0039a9958d6d service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:15:30 user nova-compute[73254]: WARNING nova.compute.manager [req-7d6f8de5-172c-4dc3-9ef6-a141b6aec2b9 req-b495009c-274b-4c3f-bbb4-0039a9958d6d service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state active and task_state None.
Aug 14 15:15:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:36 user nova-compute[73254]: INFO nova.compute.manager [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Detaching volume cceba3b0-c8cb-40d1-92cf-9bc8d75100b1
Aug 14 15:15:36 user nova-compute[73254]: INFO nova.virt.block_device [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Attempting to driver detach volume cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 from mountpoint /dev/vdb
Aug 14 15:15:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Attempting to detach device vdb from instance a651971c-b3b5-490b-b09e-6f93be59c663 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:15:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:15:36 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:15:36 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:15:36 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:15:36 user nova-compute[73254]:   <serial>cceba3b0-c8cb-40d1-92cf-9bc8d75100b1</serial>
Aug 14 15:15:36 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:15:36 user nova-compute[73254]: </disk>
Aug 14 15:15:36 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:15:36 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Successfully detached device vdb from instance a651971c-b3b5-490b-b09e-6f93be59c663 from the persistent domain config.
Aug 14 15:15:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a651971c-b3b5-490b-b09e-6f93be59c663 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:15:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:15:36 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:15:36 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:15:36 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:15:36 user nova-compute[73254]:   <serial>cceba3b0-c8cb-40d1-92cf-9bc8d75100b1</serial>
Aug 14 15:15:36 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:15:36 user nova-compute[73254]: </disk>
Aug 14 15:15:36 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026137.0614188, a651971c-b3b5-490b-b09e-6f93be59c663 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:15:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Successfully detached device vdb from instance a651971c-b3b5-490b-b09e-6f93be59c663 from the live domain config.
Aug 14 15:15:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yFxJwRrA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:15:37 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9ccede-259d-46ce-8f2b-1b1e213c76e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d1772-6283-4d39-a40f-514ccd68df39]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:15:37 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:15:37 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:15:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:15:37 user nova-compute[73254]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 (non-flash)
Aug 14 15:15:37 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:15:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6483bd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1'): ({'sdd'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Removing single pathed devices sdd {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[173fb908-1219-4c15-a903-c88ae955ebb2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d243e10a-97cc-46ee-a00f-d7889510a032]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Flushing IO for device /dev/sdd {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[687ff790-b79b-4264-9053-1fe3ccb9f1b3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2ff5df-0216-44b1-8d3c-9c42ac17194a]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5c8e9e-8033-4294-9b63-a799b0108c15]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f7dc7e-78c8-49c6-839f-18df7061c4fa]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1, portal: 172.16.0.220,3260]
Aug 14 15:15:37 user nova-compute[73254]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1, portal: 172.16.0.220,3260] successful.
Aug 14 15:15:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cceba3b0-c8cb-40d1-92cf-9bc8d75100b1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b33f3d3-8991-4d13-9bf6-42ba41573b46]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] <== disconnect_volume: return (281ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:15:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:38 user nova-compute[73254]: DEBUG nova.objects.instance [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'flavor' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:15:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-90cdc425-ec62-427b-ad8a-0148491c6f7a tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.599s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:15:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:48 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:15:48 user nova-compute[73254]: INFO nova.compute.claims [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Claim successful on node user
Aug 14 15:15:49 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:15:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:15:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG nova.policy [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ec4cf769cd15416bbbc1b9def6d12202', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f209fa7e3ab40a2b5b9dc6725195d22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:15:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Creating image(s)
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "/opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "/opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "/opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk 1073741824" returned: 0 in 0.087s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Successfully created port: d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Cannot resize image /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'migration_context' on Instance uuid 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Ensure instance console log exists: /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Successfully updated port: d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "refresh_cache-6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquired lock "refresh_cache-6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-30b2141f-d542-4ca7-8612-10d69af1c941 req-7006845a-8828-4e0d-8376-54556576e518 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received event network-changed-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-30b2141f-d542-4ca7-8612-10d69af1c941 req-7006845a-8828-4e0d-8376-54556576e518 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Refreshing instance network info cache due to event network-changed-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-30b2141f-d542-4ca7-8612-10d69af1c941 req-7006845a-8828-4e0d-8376-54556576e518 service nova] Acquiring lock "refresh_cache-6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Updating instance_info_cache with network_info: [{"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Releasing lock "refresh_cache-6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Instance network_info: |[{"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-30b2141f-d542-4ca7-8612-10d69af1c941 req-7006845a-8828-4e0d-8376-54556576e518 service nova] Acquired lock "refresh_cache-6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-30b2141f-d542-4ca7-8612-10d69af1c941 req-7006845a-8828-4e0d-8376-54556576e518 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Refreshing network info cache for port d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Start _get_guest_xml network_info=[{"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:15:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:15:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1707328756',display_name='tempest-AttachVolumeNegativeTest-server-1707328756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1707328756',id=36,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAxXNhflyhuQF8H2J9zNypRJXUlt3qzP2weBOp4A2zM43qViau+lj4W5m852428Otva0yhrqXcAxfrbWra5oht/xFkZuFbagkmYv0RZsMzPmCk10kGLKQl8I9MwNFG/aQ==',key_name='tempest-keypair-134586040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-wggni9fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:8f:ab,bridge_name='br-int',has_traffic_filtering=True,id=d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97ed2c6-8c') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'pci_devices' on Instance uuid 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:15:51 user nova-compute[73254]:   <uuid>6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1</uuid>
Aug 14 15:15:51 user nova-compute[73254]:   <name>instance-00000024</name>
Aug 14 15:15:51 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:15:51 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:15:51 user nova-compute[73254]:   <metadata>
Aug 14 15:15:51 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:15:51 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:15:51 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1707328756</nova:name>
Aug 14 15:15:51 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:15:51</nova:creationTime>
Aug 14 15:15:51 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:15:51 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:15:51 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:15:51 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:15:51 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:15:51 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:15:51 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:15:51 user nova-compute[73254]:       <nova:owner>
Aug 14 15:15:51 user nova-compute[73254]:         <nova:user uuid="ec4cf769cd15416bbbc1b9def6d12202">tempest-AttachVolumeNegativeTest-476210608-project-member</nova:user>
Aug 14 15:15:51 user nova-compute[73254]:         <nova:project uuid="8f209fa7e3ab40a2b5b9dc6725195d22">tempest-AttachVolumeNegativeTest-476210608</nova:project>
Aug 14 15:15:51 user nova-compute[73254]:       </nova:owner>
Aug 14 15:15:51 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:15:51 user nova-compute[73254]:       <nova:ports>
Aug 14 15:15:51 user nova-compute[73254]:         <nova:port uuid="d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703">
Aug 14 15:15:51 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 15:15:51 user nova-compute[73254]:         </nova:port>
Aug 14 15:15:51 user nova-compute[73254]:       </nova:ports>
Aug 14 15:15:51 user nova-compute[73254]:     </nova:instance>
Aug 14 15:15:51 user nova-compute[73254]:   </metadata>
Aug 14 15:15:51 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:15:51 user nova-compute[73254]:     <system>
Aug 14 15:15:51 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:15:51 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:15:51 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:15:51 user nova-compute[73254]:       <entry name="serial">6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1</entry>
Aug 14 15:15:51 user nova-compute[73254]:       <entry name="uuid">6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1</entry>
Aug 14 15:15:51 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:15:51 user nova-compute[73254]:     </system>
Aug 14 15:15:51 user nova-compute[73254]:   </sysinfo>
Aug 14 15:15:51 user nova-compute[73254]:   <os>
Aug 14 15:15:51 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:15:51 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:15:51 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:15:51 user nova-compute[73254]:   </os>
Aug 14 15:15:51 user nova-compute[73254]:   <features>
Aug 14 15:15:51 user nova-compute[73254]:     <acpi/>
Aug 14 15:15:51 user nova-compute[73254]:     <apic/>
Aug 14 15:15:51 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:15:51 user nova-compute[73254]:   </features>
Aug 14 15:15:51 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:15:51 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:15:51 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:15:51 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:15:51 user nova-compute[73254]:   </clock>
Aug 14 15:15:51 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:15:51 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:15:51 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:15:51 user nova-compute[73254]:   </cpu>
Aug 14 15:15:51 user nova-compute[73254]:   <devices>
Aug 14 15:15:51 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:15:51 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:15:51 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk"/>
Aug 14 15:15:51 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:15:51 user nova-compute[73254]:     </disk>
Aug 14 15:15:51 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:15:51 user nova-compute[73254]:       <mac address="fa:16:3e:3b:8f:ab"/>
Aug 14 15:15:51 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:15:51 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:15:51 user nova-compute[73254]:       <target dev="tapd97ed2c6-8c"/>
Aug 14 15:15:51 user nova-compute[73254]:     </interface>
Aug 14 15:15:51 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:15:51 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/console.log" append="off"/>
Aug 14 15:15:51 user nova-compute[73254]:     </serial>
Aug 14 15:15:51 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:15:51 user nova-compute[73254]:     <video>
Aug 14 15:15:51 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:15:51 user nova-compute[73254]:     </video>
Aug 14 15:15:51 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:15:51 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:15:51 user nova-compute[73254]:     </rng>
Aug 14 15:15:51 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:15:51 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:15:51 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:15:51 user nova-compute[73254]:     </memballoon>
Aug 14 15:15:51 user nova-compute[73254]:   </devices>
Aug 14 15:15:51 user nova-compute[73254]: </domain>
Aug 14 15:15:51 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1707328756',display_name='tempest-AttachVolumeNegativeTest-server-1707328756',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1707328756',id=36,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAxXNhflyhuQF8H2J9zNypRJXUlt3qzP2weBOp4A2zM43qViau+lj4W5m852428Otva0yhrqXcAxfrbWra5oht/xFkZuFbagkmYv0RZsMzPmCk10kGLKQl8I9MwNFG/aQ==',key_name='tempest-keypair-134586040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-wggni9fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:8f:ab,bridge_name='br-int',has_traffic_filtering=True,id=d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97ed2c6-8c') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG os_vif [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:8f:ab,bridge_name='br-int',has_traffic_filtering=True,id=d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97ed2c6-8c') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd97ed2c6-8c, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd97ed2c6-8c, col_values=(('external_ids', {'iface-id': 'd97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:8f:ab', 'vm-uuid': '6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:51 user nova-compute[73254]: INFO os_vif [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:8f:ab,bridge_name='br-int',has_traffic_filtering=True,id=d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97ed2c6-8c')
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No VIF found with MAC fa:16:3e:3b:8f:ab, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-30b2141f-d542-4ca7-8612-10d69af1c941 req-7006845a-8828-4e0d-8376-54556576e518 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Updated VIF entry in instance network info cache for port d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-30b2141f-d542-4ca7-8612-10d69af1c941 req-7006845a-8828-4e0d-8376-54556576e518 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Updating instance_info_cache with network_info: [{"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:15:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-30b2141f-d542-4ca7-8612-10d69af1c941 req-7006845a-8828-4e0d-8376-54556576e518 service nova] Releasing lock "refresh_cache-6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:15:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:53 user nova-compute[73254]: DEBUG nova.compute.manager [req-d752fd07-6137-4be6-99dc-2163d3fafbe0 req-fb14acc8-9150-49ef-92aa-fdb35b1682d8 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received event network-vif-plugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d752fd07-6137-4be6-99dc-2163d3fafbe0 req-fb14acc8-9150-49ef-92aa-fdb35b1682d8 service nova] Acquiring lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d752fd07-6137-4be6-99dc-2163d3fafbe0 req-fb14acc8-9150-49ef-92aa-fdb35b1682d8 service nova] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d752fd07-6137-4be6-99dc-2163d3fafbe0 req-fb14acc8-9150-49ef-92aa-fdb35b1682d8 service nova] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:53 user nova-compute[73254]: DEBUG nova.compute.manager [req-d752fd07-6137-4be6-99dc-2163d3fafbe0 req-fb14acc8-9150-49ef-92aa-fdb35b1682d8 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] No waiting events found dispatching network-vif-plugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:15:53 user nova-compute[73254]: WARNING nova.compute.manager [req-d752fd07-6137-4be6-99dc-2163d3fafbe0 req-fb14acc8-9150-49ef-92aa-fdb35b1682d8 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received unexpected event network-vif-plugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 for instance with vm_state building and task_state spawning.
Aug 14 15:15:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026155.0287988, 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:15:55 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] VM Resumed (Lifecycle Event)
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:15:55 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Instance spawned successfully.
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:15:55 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026155.0307589, 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:15:55 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] VM Started (Lifecycle Event)
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:15:55 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-eff399ff-bea6-48f2-8c75-3b7586d28293 req-e75776f9-0a09-417a-b9f1-2931101d96c5 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received event network-vif-plugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-eff399ff-bea6-48f2-8c75-3b7586d28293 req-e75776f9-0a09-417a-b9f1-2931101d96c5 service nova] Acquiring lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-eff399ff-bea6-48f2-8c75-3b7586d28293 req-e75776f9-0a09-417a-b9f1-2931101d96c5 service nova] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-eff399ff-bea6-48f2-8c75-3b7586d28293 req-e75776f9-0a09-417a-b9f1-2931101d96c5 service nova] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-eff399ff-bea6-48f2-8c75-3b7586d28293 req-e75776f9-0a09-417a-b9f1-2931101d96c5 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] No waiting events found dispatching network-vif-plugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:15:55 user nova-compute[73254]: WARNING nova.compute.manager [req-eff399ff-bea6-48f2-8c75-3b7586d28293 req-e75776f9-0a09-417a-b9f1-2931101d96c5 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received unexpected event network-vif-plugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 for instance with vm_state building and task_state spawning.
Aug 14 15:15:55 user nova-compute[73254]: INFO nova.compute.manager [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Took 5.60 seconds to spawn the instance on the hypervisor.
Aug 14 15:15:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:15:55 user nova-compute[73254]: INFO nova.compute.manager [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Took 6.35 seconds to build instance.
Aug 14 15:15:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a75dbd0b-62fe-4047-a309-bf66e58320e9 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.436s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:15:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:15:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-2d031044-ee6e-4186-83a9-d51b071441a4 req-f557b9fc-d358-490b-9b73-6903956ad86a service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received event network-changed-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:16:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-2d031044-ee6e-4186-83a9-d51b071441a4 req-f557b9fc-d358-490b-9b73-6903956ad86a service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Refreshing instance network info cache due to event network-changed-54fe67d2-0344-4060-b0ec-c6dcc210f1df. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:16:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2d031044-ee6e-4186-83a9-d51b071441a4 req-f557b9fc-d358-490b-9b73-6903956ad86a service nova] Acquiring lock "refresh_cache-0efd0626-539e-4e61-b537-bff7479417b0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:16:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2d031044-ee6e-4186-83a9-d51b071441a4 req-f557b9fc-d358-490b-9b73-6903956ad86a service nova] Acquired lock "refresh_cache-0efd0626-539e-4e61-b537-bff7479417b0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:16:04 user nova-compute[73254]: DEBUG nova.network.neutron [req-2d031044-ee6e-4186-83a9-d51b071441a4 req-f557b9fc-d358-490b-9b73-6903956ad86a service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Refreshing network info cache for port 54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'flavor' on Instance uuid 0efd0626-539e-4e61-b537-bff7479417b0 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:16:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Ignoring supplied device name: /dev/vdb
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.078s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:05 user nova-compute[73254]: INFO nova.compute.manager [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Attaching volume 4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd to /dev/vdb
Aug 14 15:16:05 user nova-compute[73254]: DEBUG os_brick.utils [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3dcb07-b5b1-4f5b-b606-0da99a1ee2b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[318fc933-6f71-4fe5-941d-cc9562d8bb6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0785e60-b04f-4b0a-91b8-4beafa1e51b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a330945-605f-4490-a2d2-5e744fedbce4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG nova.network.neutron [req-2d031044-ee6e-4186-83a9-d51b071441a4 req-f557b9fc-d358-490b-9b73-6903956ad86a service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Updated VIF entry in instance network info cache for port 54fe67d2-0344-4060-b0ec-c6dcc210f1df. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG nova.network.neutron [req-2d031044-ee6e-4186-83a9-d51b071441a4 req-f557b9fc-d358-490b-9b73-6903956ad86a service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Updating instance_info_cache with network_info: [{"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:16:05 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[336b9112-4ceb-43ca-9e51-c1b804d556eb]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG os_brick.utils [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Updating existing volume attachment record: 63123169-e52b-42ec-b4a5-b8136e9f2aa6 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2d031044-ee6e-4186-83a9-d51b071441a4 req-f557b9fc-d358-490b-9b73-6903956ad86a service nova] Releasing lock "refresh_cache-0efd0626-539e-4e61-b537-bff7479417b0" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:16:09 user nova-compute[73254]: INFO nova.compute.claims [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Claim successful on node user
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:10 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:16:10 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7557MB free_disk=24.896697998046875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.867s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.175s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.network.neutron [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:16:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a651971c-b3b5-490b-b09e-6f93be59c663 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0578772b-534f-4d29-9b68-d9b691d339e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0efd0626-539e-4e61-b537-bff7479417b0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 078c2370-66ff-42b3-9e41-b3b7cefed1f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:16:10 user nova-compute[73254]: INFO nova.virt.block_device [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Booting with volume-backed-image 5e61edbd-805a-4552-b424-f092693ae8cc at /dev/vda
Aug 14 15:16:10 user nova-compute[73254]: DEBUG nova.policy [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ca9fb4530574c44b1a3cfa6e1b90871', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7879ba4750fa40cf9ee6bfb1daf85fdf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:16:11 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:16:11 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:16:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:16:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.769s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Successfully created port: 0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:16:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Successfully updated port: 0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:16:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:16:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquired lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:16:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:16:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-56f95d75-265e-46c5-bf48-f282ce6100e0 req-ccc0dfdf-5799-4963-89a7-39c546c3b65b service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-changed-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:16:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-56f95d75-265e-46c5-bf48-f282ce6100e0 req-ccc0dfdf-5799-4963-89a7-39c546c3b65b service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Refreshing instance network info cache due to event network-changed-0d7a02f9-7e5d-44fa-958c-118d1d41df54. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:16:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-56f95d75-265e-46c5-bf48-f282ce6100e0 req-ccc0dfdf-5799-4963-89a7-39c546c3b65b service nova] Acquiring lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:16:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:16:13 user nova-compute[73254]: DEBUG nova.network.neutron [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Updating instance_info_cache with network_info: [{"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:16:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Releasing lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:16:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Instance network_info: |[{"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:16:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-56f95d75-265e-46c5-bf48-f282ce6100e0 req-ccc0dfdf-5799-4963-89a7-39c546c3b65b service nova] Acquired lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:16:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-56f95d75-265e-46c5-bf48-f282ce6100e0 req-ccc0dfdf-5799-4963-89a7-39c546c3b65b service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Refreshing network info cache for port 0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:16:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-56f95d75-265e-46c5-bf48-f282ce6100e0 req-ccc0dfdf-5799-4963-89a7-39c546c3b65b service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Updated VIF entry in instance network info cache for port 0d7a02f9-7e5d-44fa-958c-118d1d41df54. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:16:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-56f95d75-265e-46c5-bf48-f282ce6100e0 req-ccc0dfdf-5799-4963-89a7-39c546c3b65b service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Updating instance_info_cache with network_info: [{"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:16:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-56f95d75-265e-46c5-bf48-f282ce6100e0 req-ccc0dfdf-5799-4963-89a7-39c546c3b65b service nova] Releasing lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYVXyEFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:16:14 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:16:14 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:16:14 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e4ccdf-0144-41cf-b573-c6c914479be8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:16:14 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c72d0a-84c7-4acd-b9fd-edbe7cff1e20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd] added
Aug 14 15:16:14 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1c16b7-98b8-4f07-9198-a2a6a93efce8]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0c0633-9bd5-43cf-9ef8-7e4fd099f294]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYVXyEFK {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZYVXyEFK" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eec0c0b-2fe5-4742-857f-92095bc5af87]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZYVXyEFK'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c298674d-f835-477d-9037-702043aa3e01]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[511c8b22-fea1-4e73-84d1-8e14a01f1b6d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:14 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:14 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:14 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:14 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[560a9ac6-ac99-4950-842a-e0d115244089]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd, portal: 172.16.0.220,3260]
Aug 14 15:16:14 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd, portal: 172.16.0.220,3260] successful.
Aug 14 15:16:14 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2083ff3-7bbe-4c3f-ae9b-018a3d43fbf7]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[48753f73-e58f-49bf-bcfd-17ad9fbecf67]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:14 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:14 user nova-compute[73254]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)
Aug 14 15:16:14 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:14 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:14 user nova-compute[73254]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)
Aug 14 15:16:14 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2507bc-1092-4347-bc54-254c255e8a88]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:16:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYVXyEFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:16:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:16:15 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26433333231316639', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:16:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433333231316639', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:16:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'flavor' on Instance uuid 0efd0626-539e-4e61-b537-bff7479417b0 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:16:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:16:15 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:16:15 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:16:15 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:16:15 user nova-compute[73254]:   <serial>4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd</serial>
Aug 14 15:16:15 user nova-compute[73254]: </disk>
Aug 14 15:16:15 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] No VIF found with MAC fa:16:3e:32:fe:4b, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5bea2283-a92c-4389-9fdd-062fa670adf3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.953s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updating instance_info_cache with network_info: [{"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:16:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:16:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG os_brick.utils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de34a52-d67a-4987-8e49-83818e8163c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b148ccc0-ea4d-4952-b606-24896a66cd56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a93eb1d-33ab-4b74-97d3-93d5bd4985b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[30695bdc-51de-4583-8ac2-765ee32cf1f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:16:21 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:16:21 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[407522c7-9eab-4b5f-bfda-90f7051c533e]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG os_brick.utils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Updating existing volume attachment record: 97bd1b7d-0be6-455f-9513-263aec612160 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:16:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:27 user nova-compute[73254]: INFO nova.compute.manager [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Terminating instance
Aug 14 15:16:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-1d5894ed-5cf3-4061-a0f5-e4933bea7e39 req-79baa183-98a1-41ef-9813-8fc1642c281a service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-unplugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1d5894ed-5cf3-4061-a0f5-e4933bea7e39 req-79baa183-98a1-41ef-9813-8fc1642c281a service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1d5894ed-5cf3-4061-a0f5-e4933bea7e39 req-79baa183-98a1-41ef-9813-8fc1642c281a service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1d5894ed-5cf3-4061-a0f5-e4933bea7e39 req-79baa183-98a1-41ef-9813-8fc1642c281a service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-1d5894ed-5cf3-4061-a0f5-e4933bea7e39 req-79baa183-98a1-41ef-9813-8fc1642c281a service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-unplugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-1d5894ed-5cf3-4061-a0f5-e4933bea7e39 req-79baa183-98a1-41ef-9813-8fc1642c281a service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-unplugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:16:27 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Instance destroyed successfully.
Aug 14 15:16:27 user nova-compute[73254]: DEBUG nova.objects.instance [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lazy-loading 'resources' on Instance uuid a651971c-b3b5-490b-b09e-6f93be59c663 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:09:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-172163985',display_name='tempest-ServerStableDeviceRescueTest-server-172163985',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-172163985',id=30,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxSDJACbjhIkGWnGpSWRk519GgcSYyay2GRwh62lCPZ3y3CSlhufil/PY6EpBEH9m5Z7/xfEiNhrRF/EDZlo4ceaSq1ERJmh6bf4Gd00J2LXPtEt/9Dp39tyHYftpECEA==',key_name='tempest-keypair-868150660',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:13:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a70a43ea1458433fa79e23879bd176d4',ramdisk_id='',reservation_id='r-53sa0a7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-400577676',owner_user_name='tempest-ServerStableDeviceRescueTest-400577676-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:15:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c222956873d2461ba0f1400b64753f51',uuid=a651971c-b3b5-490b-b09e-6f93be59c663,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Converting VIF {"id": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "address": "fa:16:3e:df:e2:76", "network": {"id": "ae4f3eb0-0aec-4a48-934e-ac1cda89e0be", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-159752867-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.27", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70a43ea1458433fa79e23879bd176d4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c5b3b2e-f9", "ovs_interfaceid": "0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:e2:76,bridge_name='br-int',has_traffic_filtering=True,id=0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4,network=Network(ae4f3eb0-0aec-4a48-934e-ac1cda89e0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5b3b2e-f9') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG os_vif [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:e2:76,bridge_name='br-int',has_traffic_filtering=True,id=0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4,network=Network(ae4f3eb0-0aec-4a48-934e-ac1cda89e0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5b3b2e-f9') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c5b3b2e-f9, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:16:27 user nova-compute[73254]: INFO os_vif [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:e2:76,bridge_name='br-int',has_traffic_filtering=True,id=0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4,network=Network(ae4f3eb0-0aec-4a48-934e-ac1cda89e0be),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c5b3b2e-f9')
Aug 14 15:16:27 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Deleting instance files /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663_del
Aug 14 15:16:27 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Deletion of /opt/stack/data/nova/instances/a651971c-b3b5-490b-b09e-6f93be59c663_del complete
Aug 14 15:16:28 user nova-compute[73254]: INFO nova.compute.manager [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 14 15:16:28 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:16:28 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:16:28 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:16:29 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:16:29 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Took 1.27 seconds to deallocate network for instance.
Aug 14 15:16:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-a79615b5-eb84-4e8d-b9f5-d07680032c04 req-d7cd51ba-5364-4fb4-842d-bc940b17c80d service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:16:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a79615b5-eb84-4e8d-b9f5-d07680032c04 req-d7cd51ba-5364-4fb4-842d-bc940b17c80d service nova] Acquiring lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a79615b5-eb84-4e8d-b9f5-d07680032c04 req-d7cd51ba-5364-4fb4-842d-bc940b17c80d service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a79615b5-eb84-4e8d-b9f5-d07680032c04 req-d7cd51ba-5364-4fb4-842d-bc940b17c80d service nova] Lock "a651971c-b3b5-490b-b09e-6f93be59c663-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-a79615b5-eb84-4e8d-b9f5-d07680032c04 req-d7cd51ba-5364-4fb4-842d-bc940b17c80d service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] No waiting events found dispatching network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:16:29 user nova-compute[73254]: WARNING nova.compute.manager [req-a79615b5-eb84-4e8d-b9f5-d07680032c04 req-d7cd51ba-5364-4fb4-842d-bc940b17c80d service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received unexpected event network-vif-plugged-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 for instance with vm_state deleted and task_state None.
Aug 14 15:16:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-a79615b5-eb84-4e8d-b9f5-d07680032c04 req-d7cd51ba-5364-4fb4-842d-bc940b17c80d service nova] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Received event network-vif-deleted-0c5b3b2e-f9b2-4ac9-80d9-359b4083e6e4 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:16:29 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:16:29 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:16:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:29 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Deleted allocations for instance a651971c-b3b5-490b-b09e-6f93be59c663
Aug 14 15:16:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08450bb5-bd75-48fa-9b80-321c1bdb8503 tempest-ServerStableDeviceRescueTest-400577676 tempest-ServerStableDeviceRescueTest-400577676-project-member] Lock "a651971c-b3b5-490b-b09e-6f93be59c663" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.728s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:16:38 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Creating image(s)
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Ensure instance console log exists: /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Start _get_guest_xml network_info=[{"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '97bd1b7d-0be6-455f-9513-263aec612160', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daOqtYTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '078c2370-66ff-42b3-9e41-b3b7cefed1f2', 'attached_at': '', 'detached_at': '', 'volume_id': '481c1650-bf1f-4268-8d68-f7afe8c9e188', 'serial': '481c1650-bf1f-4268-8d68-f7afe8c9e188'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:16:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:16:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daOqtYTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:16:38 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:16:38 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:16:38 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c8748e-dda5-4354-92d1-4885ae19a106]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:16:38 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f066ab97-8f05-4c49-9321-5070d64bbfd9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188] added
Aug 14 15:16:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6b095f-7ad5-4b65-b365-62c627bdf014]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[686a6d21-5907-4dd4-b410-348e9def8224]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v daOqtYTP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v daOqtYTP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da7843b-07d4-4eb1-a11f-25ce6df3eb1b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'daOqtYTP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bec0578-d812-45c1-827b-c3b9236d9edd]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9975f44-32d9-4c26-9828-8d3977f038c2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:38 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:38 user nova-compute[73254]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)
Aug 14 15:16:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:38 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:38 user nova-compute[73254]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)
Aug 14 15:16:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f959725d-8496-4595-b7b9-6f4a94808e1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188, portal: 172.16.0.220,3260]
Aug 14 15:16:38 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188, portal: 172.16.0.220,3260] successful.
Aug 14 15:16:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c348938-2d1b-400a-a41a-748b3ed6dca8]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dc3f25-ffb4-4dc9-8f8b-c7d9ddb73fda]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:38 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:38 user nova-compute[73254]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)
Aug 14 15:16:38 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:16:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:38 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:38 user nova-compute[73254]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)
Aug 14 15:16:38 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:16:38 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f33ba1-b276-4889-89bb-827e65a47c83]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:16:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daOqtYTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26536393734636262', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536393734636262', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2089501983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2089501983',id=37,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-zg8zegya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:16:11Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=078c2370-66ff-42b3-9e41-b3b7cefed1f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3e:1d,bridge_name='br-int',has_traffic_filtering=True,id=0d7a02f9-7e5d-44fa-958c-118d1d41df54,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7a02f9-7e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'pci_devices' on Instance uuid 078c2370-66ff-42b3-9e41-b3b7cefed1f2 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:16:39 user nova-compute[73254]:   <uuid>078c2370-66ff-42b3-9e41-b3b7cefed1f2</uuid>
Aug 14 15:16:39 user nova-compute[73254]:   <name>instance-00000025</name>
Aug 14 15:16:39 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:16:39 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:16:39 user nova-compute[73254]:   <metadata>
Aug 14 15:16:39 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:16:39 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:16:39 user nova-compute[73254]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2089501983</nova:name>
Aug 14 15:16:39 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:16:38</nova:creationTime>
Aug 14 15:16:39 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:16:39 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:16:39 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:16:39 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:16:39 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:16:39 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:16:39 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:16:39 user nova-compute[73254]:       <nova:owner>
Aug 14 15:16:39 user nova-compute[73254]:         <nova:user uuid="4ca9fb4530574c44b1a3cfa6e1b90871">tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member</nova:user>
Aug 14 15:16:39 user nova-compute[73254]:         <nova:project uuid="7879ba4750fa40cf9ee6bfb1daf85fdf">tempest-ServerBootFromVolumeStableRescueTest-1955280356</nova:project>
Aug 14 15:16:39 user nova-compute[73254]:       </nova:owner>
Aug 14 15:16:39 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:16:39 user nova-compute[73254]:       <nova:ports>
Aug 14 15:16:39 user nova-compute[73254]:         <nova:port uuid="0d7a02f9-7e5d-44fa-958c-118d1d41df54">
Aug 14 15:16:39 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 15:16:39 user nova-compute[73254]:         </nova:port>
Aug 14 15:16:39 user nova-compute[73254]:       </nova:ports>
Aug 14 15:16:39 user nova-compute[73254]:     </nova:instance>
Aug 14 15:16:39 user nova-compute[73254]:   </metadata>
Aug 14 15:16:39 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:16:39 user nova-compute[73254]:     <system>
Aug 14 15:16:39 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:16:39 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:16:39 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:16:39 user nova-compute[73254]:       <entry name="serial">078c2370-66ff-42b3-9e41-b3b7cefed1f2</entry>
Aug 14 15:16:39 user nova-compute[73254]:       <entry name="uuid">078c2370-66ff-42b3-9e41-b3b7cefed1f2</entry>
Aug 14 15:16:39 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:16:39 user nova-compute[73254]:     </system>
Aug 14 15:16:39 user nova-compute[73254]:   </sysinfo>
Aug 14 15:16:39 user nova-compute[73254]:   <os>
Aug 14 15:16:39 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:16:39 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:16:39 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:16:39 user nova-compute[73254]:   </os>
Aug 14 15:16:39 user nova-compute[73254]:   <features>
Aug 14 15:16:39 user nova-compute[73254]:     <acpi/>
Aug 14 15:16:39 user nova-compute[73254]:     <apic/>
Aug 14 15:16:39 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:16:39 user nova-compute[73254]:   </features>
Aug 14 15:16:39 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:16:39 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:16:39 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:16:39 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:16:39 user nova-compute[73254]:   </clock>
Aug 14 15:16:39 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:16:39 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:16:39 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:16:39 user nova-compute[73254]:   </cpu>
Aug 14 15:16:39 user nova-compute[73254]:   <devices>
Aug 14 15:16:39 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:16:39 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:16:39 user nova-compute[73254]:       <source dev="/dev/sdd"/>
Aug 14 15:16:39 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:16:39 user nova-compute[73254]:       <serial>481c1650-bf1f-4268-8d68-f7afe8c9e188</serial>
Aug 14 15:16:39 user nova-compute[73254]:     </disk>
Aug 14 15:16:39 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:16:39 user nova-compute[73254]:       <mac address="fa:16:3e:a1:3e:1d"/>
Aug 14 15:16:39 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:16:39 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:16:39 user nova-compute[73254]:       <target dev="tap0d7a02f9-7e"/>
Aug 14 15:16:39 user nova-compute[73254]:     </interface>
Aug 14 15:16:39 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:16:39 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/console.log" append="off"/>
Aug 14 15:16:39 user nova-compute[73254]:     </serial>
Aug 14 15:16:39 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:16:39 user nova-compute[73254]:     <video>
Aug 14 15:16:39 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:16:39 user nova-compute[73254]:     </video>
Aug 14 15:16:39 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:16:39 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:16:39 user nova-compute[73254]:     </rng>
Aug 14 15:16:39 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:16:39 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:16:39 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:16:39 user nova-compute[73254]:     </memballoon>
Aug 14 15:16:39 user nova-compute[73254]:   </devices>
Aug 14 15:16:39 user nova-compute[73254]: </domain>
Aug 14 15:16:39 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2089501983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2089501983',id=37,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-zg8zegya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:16:11Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=078c2370-66ff-42b3-9e41-b3b7cefed1f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3e:1d,bridge_name='br-int',has_traffic_filtering=True,id=0d7a02f9-7e5d-44fa-958c-118d1d41df54,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7a02f9-7e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG os_vif [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3e:1d,bridge_name='br-int',has_traffic_filtering=True,id=0d7a02f9-7e5d-44fa-958c-118d1d41df54,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7a02f9-7e') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d7a02f9-7e, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0d7a02f9-7e, col_values=(('external_ids', {'iface-id': '0d7a02f9-7e5d-44fa-958c-118d1d41df54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:3e:1d', 'vm-uuid': '078c2370-66ff-42b3-9e41-b3b7cefed1f2'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:39 user nova-compute[73254]: INFO os_vif [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:3e:1d,bridge_name='br-int',has_traffic_filtering=True,id=0d7a02f9-7e5d-44fa-958c-118d1d41df54,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7a02f9-7e')
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:16:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No VIF found with MAC fa:16:3e:a1:3e:1d, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:16:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-d3a5859a-41ce-40cd-aebd-8aac4748c9c3 req-ec3dd517-592c-4083-94c5-1e006026e03c service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:16:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d3a5859a-41ce-40cd-aebd-8aac4748c9c3 req-ec3dd517-592c-4083-94c5-1e006026e03c service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d3a5859a-41ce-40cd-aebd-8aac4748c9c3 req-ec3dd517-592c-4083-94c5-1e006026e03c service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d3a5859a-41ce-40cd-aebd-8aac4748c9c3 req-ec3dd517-592c-4083-94c5-1e006026e03c service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-d3a5859a-41ce-40cd-aebd-8aac4748c9c3 req-ec3dd517-592c-4083-94c5-1e006026e03c service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:16:41 user nova-compute[73254]: WARNING nova.compute.manager [req-d3a5859a-41ce-40cd-aebd-8aac4748c9c3 req-ec3dd517-592c-4083-94c5-1e006026e03c service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state building and task_state spawning.
Aug 14 15:16:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:42 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026187.9151614, a651971c-b3b5-490b-b09e-6f93be59c663 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:16:42 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] VM Stopped (Lifecycle Event)
Aug 14 15:16:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-dbdc0a25-8219-4de2-9e9c-2479254fee21 None None] [instance: a651971c-b3b5-490b-b09e-6f93be59c663] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026203.2225332, 078c2370-66ff-42b3-9e41-b3b7cefed1f2 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:16:43 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] VM Resumed (Lifecycle Event)
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:16:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Instance spawned successfully.
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:16:43 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026203.2235463, 078c2370-66ff-42b3-9e41-b3b7cefed1f2 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:16:43 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] VM Started (Lifecycle Event)
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:16:43 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:16:43 user nova-compute[73254]: INFO nova.compute.manager [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Took 5.06 seconds to spawn the instance on the hypervisor.
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:16:43 user nova-compute[73254]: INFO nova.compute.manager [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Took 33.94 seconds to build instance.
Aug 14 15:16:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b69902b1-781e-4afa-9540-2c71a1945b45 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 34.045s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-e9f88ea3-44bc-4ee3-aee6-98744e755d5c req-5e1b26f1-081c-45ec-8537-f2b66f71319d service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e9f88ea3-44bc-4ee3-aee6-98744e755d5c req-5e1b26f1-081c-45ec-8537-f2b66f71319d service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e9f88ea3-44bc-4ee3-aee6-98744e755d5c req-5e1b26f1-081c-45ec-8537-f2b66f71319d service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e9f88ea3-44bc-4ee3-aee6-98744e755d5c req-5e1b26f1-081c-45ec-8537-f2b66f71319d service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:43 user nova-compute[73254]: DEBUG nova.compute.manager [req-e9f88ea3-44bc-4ee3-aee6-98744e755d5c req-5e1b26f1-081c-45ec-8537-f2b66f71319d service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:16:43 user nova-compute[73254]: WARNING nova.compute.manager [req-e9f88ea3-44bc-4ee3-aee6-98744e755d5c req-5e1b26f1-081c-45ec-8537-f2b66f71319d service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state active and task_state None.
Aug 14 15:16:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:54 user nova-compute[73254]: INFO nova.compute.manager [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Detaching volume 4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd
Aug 14 15:16:54 user nova-compute[73254]: INFO nova.virt.block_device [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Attempting to driver detach volume 4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd from mountpoint /dev/vdb
Aug 14 15:16:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Attempting to detach device vdb from instance 0efd0626-539e-4e61-b537-bff7479417b0 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:16:54 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:16:54 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:16:54 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:16:54 user nova-compute[73254]:   <serial>4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd</serial>
Aug 14 15:16:54 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:16:54 user nova-compute[73254]: </disk>
Aug 14 15:16:54 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:16:54 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Successfully detached device vdb from instance 0efd0626-539e-4e61-b537-bff7479417b0 from the persistent domain config.
Aug 14 15:16:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0efd0626-539e-4e61-b537-bff7479417b0 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:16:54 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:16:54 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:16:54 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:16:54 user nova-compute[73254]:   <serial>4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd</serial>
Aug 14 15:16:54 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:16:54 user nova-compute[73254]: </disk>
Aug 14 15:16:54 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026214.6788044, 0efd0626-539e-4e61-b537-bff7479417b0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0efd0626-539e-4e61-b537-bff7479417b0 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:16:54 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Successfully detached device vdb from instance 0efd0626-539e-4e61-b537-bff7479417b0 from the live domain config.
Aug 14 15:16:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYVXyEFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:16:54 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c027d21-e4be-4876-b806-10bffd3a0190]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5efcee9-f9ff-413e-95d9-69a737d1a866]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:54 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:54 user nova-compute[73254]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)
Aug 14 15:16:54 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:16:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:54 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:54 user nova-compute[73254]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd (non-flash)
Aug 14 15:16:54 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:16:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6485dea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93e6b82-cbe1-4aa7-a9da-055760615ec1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fe3278-06d0-40ed-9338-fcceb28a909b]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8438a6-d527-41d7-851f-448df2a43c4c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5d99d4-1426-4858-a197-154d152325f1]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ddb1d4-2c3e-45e9-ab7c-d26a97f59753]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f4b81-9b89-42e3-8644-ed3f129c262b]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd, portal: 172.16.0.220,3260]
Aug 14 15:16:54 user nova-compute[73254]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd, portal: 172.16.0.220,3260] successful.
Aug 14 15:16:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.132s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f97f314-7d3a-4b13-926f-353dad39aeb6]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.400s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] <== disconnect_volume: return (402ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG nova.objects.instance [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'flavor' on Instance uuid 0efd0626-539e-4e61-b537-bff7479417b0 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-16a640fe-69c4-45ce-89be-5dab30fd0ce3 tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.784s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.655s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:55 user nova-compute[73254]: INFO nova.compute.manager [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Terminating instance
Aug 14 15:16:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:16:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-bbbe5d77-7d54-493a-bd5c-b629fbec17b1 req-83c0a44e-f157-4bd4-a875-00c611b52603 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received event network-vif-unplugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bbbe5d77-7d54-493a-bd5c-b629fbec17b1 req-83c0a44e-f157-4bd4-a875-00c611b52603 service nova] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bbbe5d77-7d54-493a-bd5c-b629fbec17b1 req-83c0a44e-f157-4bd4-a875-00c611b52603 service nova] Lock "0efd0626-539e-4e61-b537-bff7479417b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bbbe5d77-7d54-493a-bd5c-b629fbec17b1 req-83c0a44e-f157-4bd4-a875-00c611b52603 service nova] Lock "0efd0626-539e-4e61-b537-bff7479417b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-bbbe5d77-7d54-493a-bd5c-b629fbec17b1 req-83c0a44e-f157-4bd4-a875-00c611b52603 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] No waiting events found dispatching network-vif-unplugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-bbbe5d77-7d54-493a-bd5c-b629fbec17b1 req-83c0a44e-f157-4bd4-a875-00c611b52603 service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received event network-vif-unplugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Instance destroyed successfully.
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lazy-loading 'resources' on Instance uuid 0efd0626-539e-4e61-b537-bff7479417b0 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:14:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-29855895',display_name='tempest-VolumesSnapshotTestJSON-instance-29855895',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-29855895',id=35,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOi8D7bplxLaCd9hJw4AnP4B2VmyGyEpX8WojL4HpYOcJ1dQthzCI6DBW+xuM+RuAIWbBASOk8KaO5wOW/pGkObrENBQVWf0pNYCg0ZFArHjUNkYsvLxaH9Ar6xeJg+dCg==',key_name='tempest-keypair-310070889',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:14:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d51019cbe3a4ce694c44fd294c26e76',ramdisk_id='',reservation_id='r-rlvf1xn0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1785106285',owner_user_name='tempest-VolumesSnapshotTestJSON-1785106285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:14:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9c372e49b3d04765aa35916ba8e2e0f8',uuid=0efd0626-539e-4e61-b537-bff7479417b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converting VIF {"id": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "address": "fa:16:3e:32:fe:4b", "network": {"id": "14baad2d-fe1d-4243-a22a-05bd70ebee79", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-967689188-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d51019cbe3a4ce694c44fd294c26e76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54fe67d2-03", "ovs_interfaceid": "54fe67d2-0344-4060-b0ec-c6dcc210f1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:fe:4b,bridge_name='br-int',has_traffic_filtering=True,id=54fe67d2-0344-4060-b0ec-c6dcc210f1df,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fe67d2-03') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_vif [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fe:4b,bridge_name='br-int',has_traffic_filtering=True,id=54fe67d2-0344-4060-b0ec-c6dcc210f1df,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fe67d2-03') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54fe67d2-03, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:16:56 user nova-compute[73254]: INFO os_vif [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:fe:4b,bridge_name='br-int',has_traffic_filtering=True,id=54fe67d2-0344-4060-b0ec-c6dcc210f1df,network=Network(14baad2d-fe1d-4243-a22a-05bd70ebee79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54fe67d2-03')
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZYVXyEFK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:16:56 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b065f13-91ec-4e1c-9b7c-7875f8cf5bbd', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de44309-4bb8-4d58-9310-3d71bd1959a3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52784ce-076a-4da6-bf7b-2d589a993dc1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:56 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:56 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:16:56 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:16:56 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:16:56 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:16:56 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd66878a050>, {}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Disconnecting from: [] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.049s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] <== disconnect_volume: return (50ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:16:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Deleting instance files /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0_del
Aug 14 15:16:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Deletion of /opt/stack/data/nova/instances/0efd0626-539e-4e61-b537-bff7479417b0_del complete
Aug 14 15:16:56 user nova-compute[73254]: INFO nova.compute.manager [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 15:16:56 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:16:56 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:16:58 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:16:58 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Took 1.33 seconds to deallocate network for instance.
Aug 14 15:16:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-d888bad4-bc59-46eb-b663-6c7607fc3a5f req-52641a36-a6a6-4e36-931b-c1ff602c9d9a service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received event network-vif-deleted-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:16:58 user nova-compute[73254]: WARNING nova.volume.cinder [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Attachment 63123169-e52b-42ec-b4a5-b8136e9f2aa6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 63123169-e52b-42ec-b4a5-b8136e9f2aa6. (HTTP 404) (Request-ID: req-85e1def0-86e5-4090-a02b-8ef89427bf8e)
Aug 14 15:16:58 user nova-compute[73254]: INFO nova.compute.manager [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Took 0.04 seconds to detach 1 volumes for instance.
Aug 14 15:16:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-bf1475f7-e1b7-4471-a21f-97481b183d9c req-a79945e9-3f9b-4d91-9622-1c56a5edcb1a service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received event network-vif-plugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:16:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bf1475f7-e1b7-4471-a21f-97481b183d9c req-a79945e9-3f9b-4d91-9622-1c56a5edcb1a service nova] Acquiring lock "0efd0626-539e-4e61-b537-bff7479417b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bf1475f7-e1b7-4471-a21f-97481b183d9c req-a79945e9-3f9b-4d91-9622-1c56a5edcb1a service nova] Lock "0efd0626-539e-4e61-b537-bff7479417b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bf1475f7-e1b7-4471-a21f-97481b183d9c req-a79945e9-3f9b-4d91-9622-1c56a5edcb1a service nova] Lock "0efd0626-539e-4e61-b537-bff7479417b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:58 user nova-compute[73254]: DEBUG nova.compute.manager [req-bf1475f7-e1b7-4471-a21f-97481b183d9c req-a79945e9-3f9b-4d91-9622-1c56a5edcb1a service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] No waiting events found dispatching network-vif-plugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:16:58 user nova-compute[73254]: WARNING nova.compute.manager [req-bf1475f7-e1b7-4471-a21f-97481b183d9c req-a79945e9-3f9b-4d91-9622-1c56a5edcb1a service nova] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Received unexpected event network-vif-plugged-54fe67d2-0344-4060-b0ec-c6dcc210f1df for instance with vm_state active and task_state deleting.
Aug 14 15:16:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:58 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:16:58 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:16:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:58 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Deleted allocations for instance 0efd0626-539e-4e61-b537-bff7479417b0
Aug 14 15:16:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1eda8865-7ca2-4f35-81e3-f476cd3eefae tempest-VolumesSnapshotTestJSON-1785106285 tempest-VolumesSnapshotTestJSON-1785106285-project-member] Lock "0efd0626-539e-4e61-b537-bff7479417b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.801s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:16:59 user nova-compute[73254]: INFO nova.compute.claims [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Claim successful on node user
Aug 14 15:16:59 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.414s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:16:59 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:16:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:16:59 user nova-compute[73254]: INFO nova.virt.block_device [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Booting with volume d4ea4429-9e60-4b62-adfd-2377409fddbb at /dev/vda
Aug 14 15:16:59 user nova-compute[73254]: DEBUG nova.policy [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e56bbc03d7af4dec928da4d490af7b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a7dd480b32e4059b4d265a6049963e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG os_brick.utils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bbb6b9-eec4-4ab9-b013-9bdf4be50f42]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[922bca04-4406-44c1-ac3c-2767cc8cd212]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1a415d-19ad-47ed-82c1-1d174e420971]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[861fa168-0bc1-4d6b-afef-90b522f09c47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:16:59 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:16:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f53c116-3db8-48c9-a283-43399125e674]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG os_brick.utils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:16:59 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating existing volume attachment record: 90378ad6-a4e9-435a-a9e6-5fba3ee120a9 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:17:00 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Successfully created port: 8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Successfully updated port: 8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquired lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-904a507a-03ff-4d60-a171-c1ba049f08b9 req-a7abf6db-4479-424f-bff1-67669a532edd service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-changed-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-904a507a-03ff-4d60-a171-c1ba049f08b9 req-a7abf6db-4479-424f-bff1-67669a532edd service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Refreshing instance network info cache due to event network-changed-8d93b8b1-b5df-46d6-a980-29042ecf502d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-904a507a-03ff-4d60-a171-c1ba049f08b9 req-a7abf6db-4479-424f-bff1-67669a532edd service nova] Acquiring lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating instance_info_cache with network_info: [{"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Releasing lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Instance network_info: |[{"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-904a507a-03ff-4d60-a171-c1ba049f08b9 req-a7abf6db-4479-424f-bff1-67669a532edd service nova] Acquired lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG nova.network.neutron [req-904a507a-03ff-4d60-a171-c1ba049f08b9 req-a7abf6db-4479-424f-bff1-67669a532edd service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Refreshing network info cache for port 8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:17:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:02 user nova-compute[73254]: DEBUG nova.network.neutron [req-904a507a-03ff-4d60-a171-c1ba049f08b9 req-a7abf6db-4479-424f-bff1-67669a532edd service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updated VIF entry in instance network info cache for port 8d93b8b1-b5df-46d6-a980-29042ecf502d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:17:02 user nova-compute[73254]: DEBUG nova.network.neutron [req-904a507a-03ff-4d60-a171-c1ba049f08b9 req-a7abf6db-4479-424f-bff1-67669a532edd service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating instance_info_cache with network_info: [{"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:17:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-904a507a-03ff-4d60-a171-c1ba049f08b9 req-a7abf6db-4479-424f-bff1-67669a532edd service nova] Releasing lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:17:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:17:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:17:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:17:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:17:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:17:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:17:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:17:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Creating image(s)
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Ensure instance console log exists: /opt/stack/data/nova/instances/5a927b8b-123f-40c7-a292-ee61f9afde9d/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Start _get_guest_xml network_info=[{"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '90378ad6-a4e9-435a-a9e6-5fba3ee120a9', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYAabuBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a927b8b-123f-40c7-a292-ee61f9afde9d', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4ea4429-9e60-4b62-adfd-2377409fddbb', 'serial': 'd4ea4429-9e60-4b62-adfd-2377409fddbb'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:17:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:17:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYAabuBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:17:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:17:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:17:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:17:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:17:08 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b46c02-9773-4bd7-be4d-4aedc8ca61ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:17:08 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edb08ee-9754-4c37-98f6-aaf7252a3b3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb] added
Aug 14 15:17:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[977cf4b2-34cb-41dc-a763-d3134576474f]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b8f17c-7668-40b0-ace0-36cac8cf19e5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYAabuBm {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYAabuBm" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d83726-c8b0-4dd0-a46d-24f7bc7340f2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GYAabuBm'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6610933c-436e-4bcd-8d81-77a40494c07a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d79795-6791-4b30-bb59-f4ac48081127]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:09 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:17:09 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:09 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:17:09 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b636aa-b68c-4fee-8f94-c92465f08df7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260]
Aug 14 15:17:09 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260] successful.
Aug 14 15:17:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e7ed5c-79dc-4319-82ca-5a36d60425a5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ebd88d-81ba-4c81-91a7-f0aef3318ed1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:09 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:17:09 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:09 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:17:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:09 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:17:09 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:09 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:17:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[68723b8b-9c89-4d91-8ebd-cd3cb114fd46]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYAabuBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26335663964393464', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335663964393464', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1601224980',display_name='tempest-ServerActionsTestOtherA-server-1601224980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1601224980',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVC3LG9bN01HlSiMNZhDA0zEYEcGLDrYhPpLJz9ta218GScDSC8eEo3thhKHy7nQaAVL89N9YcF8sXNEgn/eaLjWVETDYOO04B8PSlrVv3eBig80mH0AK7hGooJqv3yA==',key_name='tempest-keypair-384224305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-1y3gsh57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=5a927b8b-123f-40c7-a292-ee61f9afde9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a927b8b-123f-40c7-a292-ee61f9afde9d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:17:10 user nova-compute[73254]:   <uuid>5a927b8b-123f-40c7-a292-ee61f9afde9d</uuid>
Aug 14 15:17:10 user nova-compute[73254]:   <name>instance-00000026</name>
Aug 14 15:17:10 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:17:10 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:17:10 user nova-compute[73254]:   <metadata>
Aug 14 15:17:10 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:17:10 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:17:10 user nova-compute[73254]:       <nova:name>tempest-ServerActionsTestOtherA-server-1601224980</nova:name>
Aug 14 15:17:10 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:17:08</nova:creationTime>
Aug 14 15:17:10 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:17:10 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:17:10 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:17:10 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:17:10 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:17:10 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:17:10 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:17:10 user nova-compute[73254]:       <nova:owner>
Aug 14 15:17:10 user nova-compute[73254]:         <nova:user uuid="e56bbc03d7af4dec928da4d490af7b76">tempest-ServerActionsTestOtherA-1005131430-project-member</nova:user>
Aug 14 15:17:10 user nova-compute[73254]:         <nova:project uuid="8a7dd480b32e4059b4d265a6049963e4">tempest-ServerActionsTestOtherA-1005131430</nova:project>
Aug 14 15:17:10 user nova-compute[73254]:       </nova:owner>
Aug 14 15:17:10 user nova-compute[73254]:       <nova:ports>
Aug 14 15:17:10 user nova-compute[73254]:         <nova:port uuid="8d93b8b1-b5df-46d6-a980-29042ecf502d">
Aug 14 15:17:10 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 15:17:10 user nova-compute[73254]:         </nova:port>
Aug 14 15:17:10 user nova-compute[73254]:       </nova:ports>
Aug 14 15:17:10 user nova-compute[73254]:     </nova:instance>
Aug 14 15:17:10 user nova-compute[73254]:   </metadata>
Aug 14 15:17:10 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:17:10 user nova-compute[73254]:     <system>
Aug 14 15:17:10 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:17:10 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:17:10 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:17:10 user nova-compute[73254]:       <entry name="serial">5a927b8b-123f-40c7-a292-ee61f9afde9d</entry>
Aug 14 15:17:10 user nova-compute[73254]:       <entry name="uuid">5a927b8b-123f-40c7-a292-ee61f9afde9d</entry>
Aug 14 15:17:10 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:17:10 user nova-compute[73254]:     </system>
Aug 14 15:17:10 user nova-compute[73254]:   </sysinfo>
Aug 14 15:17:10 user nova-compute[73254]:   <os>
Aug 14 15:17:10 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:17:10 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:17:10 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:17:10 user nova-compute[73254]:   </os>
Aug 14 15:17:10 user nova-compute[73254]:   <features>
Aug 14 15:17:10 user nova-compute[73254]:     <acpi/>
Aug 14 15:17:10 user nova-compute[73254]:     <apic/>
Aug 14 15:17:10 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:17:10 user nova-compute[73254]:   </features>
Aug 14 15:17:10 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:17:10 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:17:10 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:17:10 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:17:10 user nova-compute[73254]:   </clock>
Aug 14 15:17:10 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:17:10 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:17:10 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:17:10 user nova-compute[73254]:   </cpu>
Aug 14 15:17:10 user nova-compute[73254]:   <devices>
Aug 14 15:17:10 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:17:10 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:17:10 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 15:17:10 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:17:10 user nova-compute[73254]:       <serial>d4ea4429-9e60-4b62-adfd-2377409fddbb</serial>
Aug 14 15:17:10 user nova-compute[73254]:     </disk>
Aug 14 15:17:10 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:17:10 user nova-compute[73254]:       <mac address="fa:16:3e:48:ca:c3"/>
Aug 14 15:17:10 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:17:10 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:17:10 user nova-compute[73254]:       <target dev="tap8d93b8b1-b5"/>
Aug 14 15:17:10 user nova-compute[73254]:     </interface>
Aug 14 15:17:10 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:17:10 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/5a927b8b-123f-40c7-a292-ee61f9afde9d/console.log" append="off"/>
Aug 14 15:17:10 user nova-compute[73254]:     </serial>
Aug 14 15:17:10 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:17:10 user nova-compute[73254]:     <video>
Aug 14 15:17:10 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:17:10 user nova-compute[73254]:     </video>
Aug 14 15:17:10 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:17:10 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:17:10 user nova-compute[73254]:     </rng>
Aug 14 15:17:10 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:17:10 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:17:10 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:17:10 user nova-compute[73254]:     </memballoon>
Aug 14 15:17:10 user nova-compute[73254]:   </devices>
Aug 14 15:17:10 user nova-compute[73254]: </domain>
Aug 14 15:17:10 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1601224980',display_name='tempest-ServerActionsTestOtherA-server-1601224980',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1601224980',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVC3LG9bN01HlSiMNZhDA0zEYEcGLDrYhPpLJz9ta218GScDSC8eEo3thhKHy7nQaAVL89N9YcF8sXNEgn/eaLjWVETDYOO04B8PSlrVv3eBig80mH0AK7hGooJqv3yA==',key_name='tempest-keypair-384224305',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-1y3gsh57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=5a927b8b-123f-40c7-a292-ee61f9afde9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG os_vif [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d93b8b1-b5, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d93b8b1-b5, col_values=(('external_ids', {'iface-id': '8d93b8b1-b5df-46d6-a980-29042ecf502d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:ca:c3', 'vm-uuid': '5a927b8b-123f-40c7-a292-ee61f9afde9d'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:10 user nova-compute[73254]: INFO os_vif [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5')
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No VIF found with MAC fa:16:3e:48:ca:c3, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:11 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:17:11 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7750MB free_disk=25.018882751464844GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0578772b-534f-4d29-9b68-d9b691d339e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 078c2370-66ff-42b3-9e41-b3b7cefed1f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 5a927b8b-123f-40c7-a292-ee61f9afde9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026216.6912065, 0efd0626-539e-4e61-b537-bff7479417b0 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:17:11 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] VM Stopped (Lifecycle Event)
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-069022dc-1e36-4bf6-9743-9f513c4444e5 None None] [instance: 0efd0626-539e-4e61-b537-bff7479417b0] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-20c139b9-5e99-44bb-bc79-4f3233c8506b req-b663de97-4cab-49e8-ae8a-f127569c19a3 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-20c139b9-5e99-44bb-bc79-4f3233c8506b req-b663de97-4cab-49e8-ae8a-f127569c19a3 service nova] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-20c139b9-5e99-44bb-bc79-4f3233c8506b req-b663de97-4cab-49e8-ae8a-f127569c19a3 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-20c139b9-5e99-44bb-bc79-4f3233c8506b req-b663de97-4cab-49e8-ae8a-f127569c19a3 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:17:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-20c139b9-5e99-44bb-bc79-4f3233c8506b req-b663de97-4cab-49e8-ae8a-f127569c19a3 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] No waiting events found dispatching network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:17:11 user nova-compute[73254]: WARNING nova.compute.manager [req-20c139b9-5e99-44bb-bc79-4f3233c8506b req-b663de97-4cab-49e8-ae8a-f127569c19a3 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received unexpected event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d for instance with vm_state building and task_state spawning.
Aug 14 15:17:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026233.7078097, 5a927b8b-123f-40c7-a292-ee61f9afde9d => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:17:13 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] VM Resumed (Lifecycle Event)
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:17:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Instance spawned successfully.
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:17:13 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026233.7096453, 5a927b8b-123f-40c7-a292-ee61f9afde9d => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:17:13 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] VM Started (Lifecycle Event)
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:17:13 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:17:13 user nova-compute[73254]: INFO nova.compute.manager [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Took 5.08 seconds to spawn the instance on the hypervisor.
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:17:13 user nova-compute[73254]: INFO nova.compute.manager [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Took 14.85 seconds to build instance.
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-5860ba3b-bd4d-4ae0-abf8-f21ceae30d6a req-c569a740-0af5-43f1-a7bf-c8f2f4dcf841 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5860ba3b-bd4d-4ae0-abf8-f21ceae30d6a req-c569a740-0af5-43f1-a7bf-c8f2f4dcf841 service nova] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5860ba3b-bd4d-4ae0-abf8-f21ceae30d6a req-c569a740-0af5-43f1-a7bf-c8f2f4dcf841 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5860ba3b-bd4d-4ae0-abf8-f21ceae30d6a req-c569a740-0af5-43f1-a7bf-c8f2f4dcf841 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:17:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-5860ba3b-bd4d-4ae0-abf8-f21ceae30d6a req-c569a740-0af5-43f1-a7bf-c8f2f4dcf841 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] No waiting events found dispatching network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:17:13 user nova-compute[73254]: WARNING nova.compute.manager [req-5860ba3b-bd4d-4ae0-abf8-f21ceae30d6a req-c569a740-0af5-43f1-a7bf-c8f2f4dcf841 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received unexpected event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d for instance with vm_state active and task_state None.
Aug 14 15:17:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c249a941-c52a-4b15-994e-d7e899ad84ac tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.941s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:17:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:17:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:17:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:17:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:17:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:15 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:17:15 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:17:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:17:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:17:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:17:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:17:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-4bbd5d19-fa0c-431d-a5c9-7a4570ffe53a req-d39aee2c-91d3-40bd-8550-96d98e1eff2a service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-changed-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-4bbd5d19-fa0c-431d-a5c9-7a4570ffe53a req-d39aee2c-91d3-40bd-8550-96d98e1eff2a service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Refreshing instance network info cache due to event network-changed-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4bbd5d19-fa0c-431d-a5c9-7a4570ffe53a req-d39aee2c-91d3-40bd-8550-96d98e1eff2a service nova] Acquiring lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating instance_info_cache with network_info: [{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4bbd5d19-fa0c-431d-a5c9-7a4570ffe53a req-d39aee2c-91d3-40bd-8550-96d98e1eff2a service nova] Acquired lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-4bbd5d19-fa0c-431d-a5c9-7a4570ffe53a req-d39aee2c-91d3-40bd-8550-96d98e1eff2a service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Refreshing network info cache for port 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:17:17 user nova-compute[73254]: INFO nova.compute.manager [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Detaching volume 2212a67c-66bc-4216-878d-ecaf6e4e10ba
Aug 14 15:17:17 user nova-compute[73254]: INFO nova.virt.block_device [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Attempting to driver detach volume 2212a67c-66bc-4216-878d-ecaf6e4e10ba from mountpoint /dev/vdb
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Attempting to detach device vdb from instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:17:17 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:17:17 user nova-compute[73254]:   <source dev="/dev/sde"/>
Aug 14 15:17:17 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:17:17 user nova-compute[73254]:   <serial>2212a67c-66bc-4216-878d-ecaf6e4e10ba</serial>
Aug 14 15:17:17 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:17:17 user nova-compute[73254]: </disk>
Aug 14 15:17:17 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:17:17 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Successfully detached device vdb from instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e from the persistent domain config.
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:17:17 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:17:17 user nova-compute[73254]:   <source dev="/dev/sde"/>
Aug 14 15:17:17 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:17:17 user nova-compute[73254]:   <serial>2212a67c-66bc-4216-878d-ecaf6e4e10ba</serial>
Aug 14 15:17:17 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:17:17 user nova-compute[73254]: </disk>
Aug 14 15:17:17 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-4bbd5d19-fa0c-431d-a5c9-7a4570ffe53a req-d39aee2c-91d3-40bd-8550-96d98e1eff2a service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updated VIF entry in instance network info cache for port 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-4bbd5d19-fa0c-431d-a5c9-7a4570ffe53a req-d39aee2c-91d3-40bd-8550-96d98e1eff2a service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating instance_info_cache with network_info: [{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:17:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4bbd5d19-fa0c-431d-a5c9-7a4570ffe53a req-d39aee2c-91d3-40bd-8550-96d98e1eff2a service nova] Releasing lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026238.2837512, ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:17:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Successfully detached device vdb from instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e from the live domain config.
Aug 14 15:17:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OCWVUDgE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:17:18 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bdda4d4-fe11-4483-a708-83152e076f48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfacdefb-0415-408a-8090-df20d49c5e6e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:18 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:17:18 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:18 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:17:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:18 user nova-compute[73254]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba (non-flash)
Aug 14 15:17:18 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:18 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:17:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648690310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba'): ({'sde'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Removing single pathed devices sde {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20257d5-5ab3-4694-949a-c5d4551212c9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d96736e-ba18-4d56-be33-ebe5b892ba55]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Flushing IO for device /dev/sde {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28fe6b6-34ae-4453-b63d-01ce775efb6e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[408ed757-2502-48f9-84df-ea1e1ea0c96d]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] SCSI volumes sde have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[089e5c33-57a0-4c0b-8014-6a2d9d247f6c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[554dd9ad-672d-4a10-b1b4-7a88de22ad8d]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba, portal: 172.16.0.220,3260]
Aug 14 15:17:18 user nova-compute[73254]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba, portal: 172.16.0.220,3260] successful.
Aug 14 15:17:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2212a67c-66bc-4216-878d-ecaf6e4e10ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabe33b2-93ad-402e-b0db-1dccd3967924]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] <== disconnect_volume: return (302ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:17:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:17:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-dbed9ee4-5e16-446b-aa93-c177415d9bba req-63546fa2-d0be-4e84-800d-a21daf9bb4af service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-changed-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:17:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-dbed9ee4-5e16-446b-aa93-c177415d9bba req-63546fa2-d0be-4e84-800d-a21daf9bb4af service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Refreshing instance network info cache due to event network-changed-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:17:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-dbed9ee4-5e16-446b-aa93-c177415d9bba req-63546fa2-d0be-4e84-800d-a21daf9bb4af service nova] Acquiring lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:17:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-dbed9ee4-5e16-446b-aa93-c177415d9bba req-63546fa2-d0be-4e84-800d-a21daf9bb4af service nova] Acquired lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:17:19 user nova-compute[73254]: DEBUG nova.network.neutron [req-dbed9ee4-5e16-446b-aa93-c177415d9bba req-63546fa2-d0be-4e84-800d-a21daf9bb4af service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Refreshing network info cache for port 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:17:19 user nova-compute[73254]: DEBUG nova.network.neutron [req-dbed9ee4-5e16-446b-aa93-c177415d9bba req-63546fa2-d0be-4e84-800d-a21daf9bb4af service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updated VIF entry in instance network info cache for port 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:17:19 user nova-compute[73254]: DEBUG nova.network.neutron [req-dbed9ee4-5e16-446b-aa93-c177415d9bba req-63546fa2-d0be-4e84-800d-a21daf9bb4af service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating instance_info_cache with network_info: [{"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:17:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-dbed9ee4-5e16-446b-aa93-c177415d9bba req-63546fa2-d0be-4e84-800d-a21daf9bb4af service nova] Releasing lock "refresh_cache-ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:17:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:24 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'flavor' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:17:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5de30ccd-2f50-4213-91a2-2f8e67095716 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.537s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:17:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-5691ddb2-8116-400a-a149-d0d985d6628b req-e5334cfd-3a21-4e63-8b02-9895b6966229 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received event network-changed-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:17:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-5691ddb2-8116-400a-a149-d0d985d6628b req-e5334cfd-3a21-4e63-8b02-9895b6966229 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Refreshing instance network info cache due to event network-changed-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:17:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5691ddb2-8116-400a-a149-d0d985d6628b req-e5334cfd-3a21-4e63-8b02-9895b6966229 service nova] Acquiring lock "refresh_cache-6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:17:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5691ddb2-8116-400a-a149-d0d985d6628b req-e5334cfd-3a21-4e63-8b02-9895b6966229 service nova] Acquired lock "refresh_cache-6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:17:40 user nova-compute[73254]: DEBUG nova.network.neutron [req-5691ddb2-8116-400a-a149-d0d985d6628b req-e5334cfd-3a21-4e63-8b02-9895b6966229 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Refreshing network info cache for port d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:17:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:40 user nova-compute[73254]: DEBUG nova.network.neutron [req-5691ddb2-8116-400a-a149-d0d985d6628b req-e5334cfd-3a21-4e63-8b02-9895b6966229 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Updated VIF entry in instance network info cache for port d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:17:40 user nova-compute[73254]: DEBUG nova.network.neutron [req-5691ddb2-8116-400a-a149-d0d985d6628b req-e5334cfd-3a21-4e63-8b02-9895b6966229 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Updating instance_info_cache with network_info: [{"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:17:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5691ddb2-8116-400a-a149-d0d985d6628b req-e5334cfd-3a21-4e63-8b02-9895b6966229 service nova] Releasing lock "refresh_cache-6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:17:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:17:44 user nova-compute[73254]: INFO nova.compute.manager [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Attaching volume 57e1f21d-419c-41d6-abdc-00b026a0bcdf to /dev/vdb
Aug 14 15:17:44 user nova-compute[73254]: DEBUG os_brick.utils [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aec2a2b-842d-4aea-9268-1fbf9d34a294]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca9d607-6d38-4eb8-ac80-9ef5545ddb55]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6e5056-0674-4736-a189-a000ad350ba0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9563b6b6-3636-40b1-85b7-4f09c153fdfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:17:44 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:17:44 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a93c4ee-366f-4e73-b684-b3cb1f5ea720]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG os_brick.utils [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:17:44 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Updating existing volume attachment record: c81219bb-1818-44ab-9adb-8aa38ec8f1ea {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:17:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pldAkbrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:17:53 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:17:53 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:17:53 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de59059-2ccb-412b-8957-d83b75227a95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:17:53 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbe116a-7424-45dc-bc03-f98839f99930]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf] added
Aug 14 15:17:53 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[944e983b-99ec-4938-b2c3-ff45a16de1d1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5ee6aa-24ed-491d-af1a-d28916eafba7]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pldAkbrc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pldAkbrc" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[756d7b7d-9e46-4806-addd-bd0a49e9c15d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pldAkbrc'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeabedb-4bb4-4b42-a474-aba16f45b79d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebae4ada-bc1b-4fa5-87e2-4e83c0fbd918]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:53 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:53 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:17:53 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:53 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:53 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:17:53 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c06dc8-5190-4158-b469-bb7726fa8c93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf, portal: 172.16.0.220,3260]
Aug 14 15:17:53 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf, portal: 172.16.0.220,3260] successful.
Aug 14 15:17:53 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d91496-cf97-4f78-a7b1-02d6942f8778]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3208d6-6d29-4eb2-8d42-596f79d229cf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:53 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:53 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:17:53 user nova-compute[73254]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf (non-flash)
Aug 14 15:17:53 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:53 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:53 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:17:53 user nova-compute[73254]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf (non-flash)
Aug 14 15:17:53 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fa636e-e73f-416b-8459-6e9727e48237]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:17:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pldAkbrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:17:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:17:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23731383566666664', 'path': '/dev/sde'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:17:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731383566666664', 'path': '/dev/sde'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:17:54 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:17:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:17:54 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:17:54 user nova-compute[73254]:   <source dev="/dev/sde"/>
Aug 14 15:17:54 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:17:54 user nova-compute[73254]:   <serial>57e1f21d-419c-41d6-abdc-00b026a0bcdf</serial>
Aug 14 15:17:54 user nova-compute[73254]: </disk>
Aug 14 15:17:54 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:17:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:17:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:17:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] No VIF found with MAC fa:16:3e:3b:8f:ab, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:17:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a8da8fa1-bd41-4bba-ba7e-c8e123aaa6a7 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.092s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:17:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:17:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:17:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:17:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:17:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:17:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:17:56 user nova-compute[73254]: INFO nova.compute.manager [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Detaching volume 57e1f21d-419c-41d6-abdc-00b026a0bcdf
Aug 14 15:17:56 user nova-compute[73254]: INFO nova.virt.block_device [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Attempting to driver detach volume 57e1f21d-419c-41d6-abdc-00b026a0bcdf from mountpoint /dev/vdb
Aug 14 15:17:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Attempting to detach device vdb from instance 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:17:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:17:56 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:17:56 user nova-compute[73254]:   <source dev="/dev/sde"/>
Aug 14 15:17:56 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:17:56 user nova-compute[73254]:   <serial>57e1f21d-419c-41d6-abdc-00b026a0bcdf</serial>
Aug 14 15:17:56 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:17:56 user nova-compute[73254]: </disk>
Aug 14 15:17:56 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:17:56 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully detached device vdb from instance 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 from the persistent domain config.
Aug 14 15:17:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:17:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:17:56 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:17:56 user nova-compute[73254]:   <source dev="/dev/sde"/>
Aug 14 15:17:56 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:17:56 user nova-compute[73254]:   <serial>57e1f21d-419c-41d6-abdc-00b026a0bcdf</serial>
Aug 14 15:17:56 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:17:56 user nova-compute[73254]: </disk>
Aug 14 15:17:56 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026277.0011575, 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:17:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully detached device vdb from instance 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 from the live domain config.
Aug 14 15:17:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pldAkbrc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:17:57 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccaecb1-b680-4bb2-9ec0-1a239d7fc47a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd09e46-501d-4f2a-9b1e-fcf5670b3760]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:57 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:57 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:17:57 user nova-compute[73254]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf (non-flash)
Aug 14 15:17:57 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:17:57 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:17:57 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:17:57 user nova-compute[73254]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf (non-flash)
Aug 14 15:17:57 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6880a30a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf'): ({'sde'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Removing single pathed devices sde {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9857b8-054a-4e33-a974-fc2684f8bbea]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65907a1-5af1-487e-9e7a-262dcb80b15c]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Flushing IO for device /dev/sde {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbc0462-688b-4274-9bda-33054ca8c876]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf6c84d-a76c-4d5f-9c35-1ecc10cdde3f]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] SCSI volumes sde have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7798e78f-8ab8-4df5-9a12-ea78b768e4f8]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc21ca7-8ce0-44df-be1a-a14ef572d027]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf, portal: 172.16.0.220,3260]
Aug 14 15:17:57 user nova-compute[73254]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf, portal: 172.16.0.220,3260] successful.
Aug 14 15:17:57 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:57e1f21d-419c-41d6-abdc-00b026a0bcdf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea32a0a-db69-4e95-aa2b-c1cf85579627]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] <== disconnect_volume: return (325ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:17:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:17:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'flavor' on Instance uuid 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:17:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-37033332-628c-426c-ad21-f0981f9135c0 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.840s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:00 user nova-compute[73254]: INFO nova.compute.manager [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Rescuing
Aug 14 15:18:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:18:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquired lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:18:00 user nova-compute[73254]: DEBUG nova.network.neutron [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:18:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:00 user nova-compute[73254]: DEBUG nova.network.neutron [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Updating instance_info_cache with network_info: [{"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:18:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Releasing lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:18:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-f45b023f-7959-4639-92db-3301249b3110 req-7f47ba56-5d7e-4ade-a199-941ebe192df7 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-unplugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f45b023f-7959-4639-92db-3301249b3110 req-7f47ba56-5d7e-4ade-a199-941ebe192df7 service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f45b023f-7959-4639-92db-3301249b3110 req-7f47ba56-5d7e-4ade-a199-941ebe192df7 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f45b023f-7959-4639-92db-3301249b3110 req-7f47ba56-5d7e-4ade-a199-941ebe192df7 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-f45b023f-7959-4639-92db-3301249b3110 req-7f47ba56-5d7e-4ade-a199-941ebe192df7 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-unplugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:18:01 user nova-compute[73254]: WARNING nova.compute.manager [req-f45b023f-7959-4639-92db-3301249b3110 req-7f47ba56-5d7e-4ade-a199-941ebe192df7 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-unplugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state active and task_state rescuing.
Aug 14 15:18:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:01 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Instance destroyed successfully.
Aug 14 15:18:01 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Attempting a stable device rescue
Aug 14 15:18:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73254) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Instance directory exists: not creating {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 15:18:01 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Creating image(s)
Aug 14 15:18:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "/opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "/opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "/opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG nova.objects.instance [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'trusted_certs' on Instance uuid 078c2370-66ff-42b3-9e41-b3b7cefed1f2 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "73e9720f7296a0ec0c4d44ee7033cd4e997f0205" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "73e9720f7296a0ec0c4d44ee7033cd4e997f0205" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205.part --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205.part --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:02 user nova-compute[73254]: DEBUG nova.virt.images [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] 0cfb0c23-f32e-45a3-a5f2-b3316b0b5236 was qcow2, converting to raw {{(pid=73254) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 14 15:18:02 user nova-compute[73254]: DEBUG nova.privsep.utils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73254) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 14 15:18:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205.part /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205.converted {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG nova.compute.manager [req-0d6c1a51-a87f-4581-8a3c-b799c0d3d6c1 req-5044650f-7102-40ff-8998-6afc912b28fb service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0d6c1a51-a87f-4581-8a3c-b799c0d3d6c1 req-5044650f-7102-40ff-8998-6afc912b28fb service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0d6c1a51-a87f-4581-8a3c-b799c0d3d6c1 req-5044650f-7102-40ff-8998-6afc912b28fb service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0d6c1a51-a87f-4581-8a3c-b799c0d3d6c1 req-5044650f-7102-40ff-8998-6afc912b28fb service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG nova.compute.manager [req-0d6c1a51-a87f-4581-8a3c-b799c0d3d6c1 req-5044650f-7102-40ff-8998-6afc912b28fb service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:18:03 user nova-compute[73254]: WARNING nova.compute.manager [req-0d6c1a51-a87f-4581-8a3c-b799c0d3d6c1 req-5044650f-7102-40ff-8998-6afc912b28fb service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state active and task_state rescuing.
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205.part /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205.converted" returned: 0 in 0.537s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205.converted --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "73e9720f7296a0ec0c4d44ee7033cd4e997f0205" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.159s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "73e9720f7296a0ec0c4d44ee7033cd4e997f0205" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "73e9720f7296a0ec0c4d44ee7033cd4e997f0205" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205 --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205 --force-share --output=json" returned: 0 in 0.211s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205,backing_fmt=raw /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205,backing_fmt=raw /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue" returned: 0 in 0.067s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "73e9720f7296a0ec0c4d44ee7033cd4e997f0205" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.objects.instance [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'migration_context' on Instance uuid 078c2370-66ff-42b3-9e41-b3b7cefed1f2 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Start _get_guest_xml network_info=[{"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "vif_mac": "fa:16:3e:a1:3e:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0cfb0c23-f32e-45a3-a5f2-b3316b0b5236', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '97bd1b7d-0be6-455f-9513-263aec612160', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daOqtYTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '078c2370-66ff-42b3-9e41-b3b7cefed1f2', 'attached_at': '', 'detached_at': '', 'volume_id': '481c1650-bf1f-4268-8d68-f7afe8c9e188', 'serial': '481c1650-bf1f-4268-8d68-f7afe8c9e188'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.objects.instance [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'resources' on Instance uuid 078c2370-66ff-42b3-9e41-b3b7cefed1f2 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.objects.instance [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'numa_topology' on Instance uuid 078c2370-66ff-42b3-9e41-b3b7cefed1f2 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:04 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:18:04 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.objects.instance [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'vcpu_model' on Instance uuid 078c2370-66ff-42b3-9e41-b3b7cefed1f2 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daOqtYTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:18:04 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:18:04 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:18:04 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba89b0e-8fa1-4e37-ba2b-46562bde3980]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = daOqtYTP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 14 15:18:04 user nova-compute[73254]: node.name = iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188
Aug 14 15:18:04 user nova-compute[73254]: node.tpgt = -1
Aug 14 15:18:04 user nova-compute[73254]: node.startup = automatic
Aug 14 15:18:04 user nova-compute[73254]: node.leading_login = No
Aug 14 15:18:04 user nova-compute[73254]: iface.iscsi_ifacename = default
Aug 14 15:18:04 user nova-compute[73254]: iface.net_ifacename = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.ipaddress = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.prefix_len = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.hwaddress = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.transport_name = tcp
Aug 14 15:18:04 user nova-compute[73254]: iface.initiatorname = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.state = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.vlan_id = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.vlan_priority = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.vlan_state = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.iface_num = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.mtu = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.port = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.bootproto = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.subnet_mask = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.gateway = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.dhcp_alt_client_id_state = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.dhcp_alt_client_id = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.dhcp_dns = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.dhcp_learn_iqn = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.dhcp_req_vendor_id_state = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.dhcp_vendor_id_state = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.dhcp_vendor_id = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.dhcp_slp_da = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.fragmentation = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.gratuitous_arp = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.incoming_forwarding = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.tos_state = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.tos = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.ttl = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.delayed_ack = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.tcp_nagle = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.tcp_wsf_state = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.tcp_wsf = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.tcp_timer_scale = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.tcp_timestamp = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.redirect = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.def_task_mgmt_timeout = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.header_digest = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.data_digest = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.immediate_data = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.initial_r2t = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.data_seq_inorder = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.data_pdu_inorder = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.erl = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.max_receive_data_len = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.first_burst_len = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.max_outstanding_r2t = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.max_burst_len = 0
Aug 14 15:18:04 user nova-compute[73254]: iface.chap_auth = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.bidi_chap = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.strict_login_compliance = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.discovery_auth = <empty>
Aug 14 15:18:04 user nova-compute[73254]: iface.discovery_logout = <empty>
Aug 14 15:18:04 user nova-compute[73254]: node.discovery_address = <empty>
Aug 14 15:18:04 user nova-compute[73254]: node.discovery_port = 0
Aug 14 15:18:04 user nova-compute[73254]: node.discovery_type = static
Aug 14 15:18:04 user nova-compute[73254]: node.session.initial_cmdsn = 0
Aug 14 15:18:04 user nova-compute[73254]: node.session.initial_login_retry_max = 8
Aug 14 15:18:04 user nova-compute[73254]: node.session.xmit_thread_priority = -20
Aug 14 15:18:04 user nova-compute[73254]: node.session.cmds_max = 128
Aug 14 15:18:04 user nova-compute[73254]: node.session.queue_depth = 32
Aug 14 15:18:04 user nova-compute[73254]: node.session.nr_sessions = 1
Aug 14 15:18:04 user nova-compute[73254]: node.session.auth.authmethod = CHAP
Aug 14 15:18:04 user nova-compute[73254]: node.session.auth.username = daOqtYTP
Aug 14 15:18:04 user nova-compute[73254]: node.session.auth.password = ***
Aug 14 15:18:04 user nova-compute[73254]: node.session.auth.username_in = <empty>
Aug 14 15:18:04 user nova-compute[73254]: node.session.auth.password_in = <empty>
Aug 14 15:18:04 user nova-compute[73254]: node.session.auth.chap_algs = MD5
Aug 14 15:18:04 user nova-compute[73254]: node.session.timeo.replacement_timeout = 120
Aug 14 15:18:04 user nova-compute[73254]: node.session.err_timeo.abort_timeout = 15
Aug 14 15:18:04 user nova-compute[73254]: node.session.err_timeo.lu_reset_timeout = 30
Aug 14 15:18:04 user nova-compute[73254]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 14 15:18:04 user nova-compute[73254]: node.session.err_timeo.host_reset_timeout = 60
Aug 14 15:18:04 user nova-compute[73254]: node.session.iscsi.FastAbort = Yes
Aug 14 15:18:04 user nova-compute[73254]: node.session.iscsi.InitialR2T = No
Aug 14 15:18:04 user nova-compute[73254]: node.session.iscsi.ImmediateData = Yes
Aug 14 15:18:04 user nova-compute[73254]: node.session.iscsi.FirstBurstLength = 262144
Aug 14 15:18:04 user nova-compute[73254]: node.session.iscsi.MaxBurstLength = 16776192
Aug 14 15:18:04 user nova-compute[73254]: node.session.iscsi.DefaultTime2Retain = 0
Aug 14 15:18:04 user nova-compute[73254]: node.session.iscsi.DefaultTime2Wait = 2
Aug 14 15:18:04 user nova-compute[73254]: node.session.iscsi.MaxConnections = 1
Aug 14 15:18:04 user nova-compute[73254]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 14 15:18:04 user nova-compute[73254]: node.session.iscsi.ERL = 0
Aug 14 15:18:04 user nova-compute[73254]: node.session.scan = manual
Aug 14 15:18:04 user nova-compute[73254]: node.session.reopen_max = 0
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].address = 172.16.0.220
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].port = 3260
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].startup = manual
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].tcp.window_size = 524288
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].tcp.type_of_service = 0
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].timeo.logout_timeout = 15
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].timeo.login_timeout = 15
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].timeo.auth_timeout = 45
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].timeo.noop_out_interval = 5
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].timeo.noop_out_timeout = 5
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].iscsi.HeaderDigest = None
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].iscsi.DataDigest = None
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].iscsi.IFMarker = No
Aug 14 15:18:04 user nova-compute[73254]: node.conn[0].iscsi.OFMarker = No
Aug 14 15:18:04 user nova-compute[73254]: # END RECORD
Aug 14 15:18:04 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[928ec593-2900-4521-af4a-b05e199fc0b5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aed6564-5436-4f8e-addb-4ba9a6ad342d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v daOqtYTP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v daOqtYTP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5857287-020b-41f1-bfba-eefcdc20a87a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'daOqtYTP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[49232aee-795c-4827-8e6e-6e4418dff2bc]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fc1c07-485f-4f76-9d18-dee6d97c6677]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:18:04 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:18:04 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:18:04 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:18:04 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:18:04 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:18:04 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] HCTL ('35', '0', '0', 0) found on session 36 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b733cd-6af9-4f8e-9a3e-d6889447c4e7]: (4, ('0 0 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Searching for a device in session 36 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daOqtYTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.189s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] <== connect_volume: return (190ms) {'type': 'block', 'scsi_wwn': '26536393734636262', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536393734636262', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2089501983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2089501983',id=37,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:16:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-zg8zegya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:16:43Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=078c2370-66ff-42b3-9e41-b3b7cefed1f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "vif_mac": "fa:16:3e:a1:3e:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "vif_mac": "fa:16:3e:a1:3e:1d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3e:1d,bridge_name='br-int',has_traffic_filtering=True,id=0d7a02f9-7e5d-44fa-958c-118d1d41df54,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7a02f9-7e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.objects.instance [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'pci_devices' on Instance uuid 078c2370-66ff-42b3-9e41-b3b7cefed1f2 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:18:04 user nova-compute[73254]:   <uuid>078c2370-66ff-42b3-9e41-b3b7cefed1f2</uuid>
Aug 14 15:18:04 user nova-compute[73254]:   <name>instance-00000025</name>
Aug 14 15:18:04 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:18:04 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:18:04 user nova-compute[73254]:   <metadata>
Aug 14 15:18:04 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:18:04 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:18:04 user nova-compute[73254]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2089501983</nova:name>
Aug 14 15:18:04 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:18:04</nova:creationTime>
Aug 14 15:18:04 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:18:04 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:18:04 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:18:04 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:18:04 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:18:04 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:18:04 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:18:04 user nova-compute[73254]:       <nova:owner>
Aug 14 15:18:04 user nova-compute[73254]:         <nova:user uuid="4ca9fb4530574c44b1a3cfa6e1b90871">tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member</nova:user>
Aug 14 15:18:04 user nova-compute[73254]:         <nova:project uuid="7879ba4750fa40cf9ee6bfb1daf85fdf">tempest-ServerBootFromVolumeStableRescueTest-1955280356</nova:project>
Aug 14 15:18:04 user nova-compute[73254]:       </nova:owner>
Aug 14 15:18:04 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:18:04 user nova-compute[73254]:       <nova:ports>
Aug 14 15:18:04 user nova-compute[73254]:         <nova:port uuid="0d7a02f9-7e5d-44fa-958c-118d1d41df54">
Aug 14 15:18:04 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 15:18:04 user nova-compute[73254]:         </nova:port>
Aug 14 15:18:04 user nova-compute[73254]:       </nova:ports>
Aug 14 15:18:04 user nova-compute[73254]:     </nova:instance>
Aug 14 15:18:04 user nova-compute[73254]:   </metadata>
Aug 14 15:18:04 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:18:04 user nova-compute[73254]:     <system>
Aug 14 15:18:04 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:18:04 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:18:04 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:18:04 user nova-compute[73254]:       <entry name="serial">078c2370-66ff-42b3-9e41-b3b7cefed1f2</entry>
Aug 14 15:18:04 user nova-compute[73254]:       <entry name="uuid">078c2370-66ff-42b3-9e41-b3b7cefed1f2</entry>
Aug 14 15:18:04 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:18:04 user nova-compute[73254]:     </system>
Aug 14 15:18:04 user nova-compute[73254]:   </sysinfo>
Aug 14 15:18:04 user nova-compute[73254]:   <os>
Aug 14 15:18:04 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:18:04 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:18:04 user nova-compute[73254]:   </os>
Aug 14 15:18:04 user nova-compute[73254]:   <features>
Aug 14 15:18:04 user nova-compute[73254]:     <acpi/>
Aug 14 15:18:04 user nova-compute[73254]:     <apic/>
Aug 14 15:18:04 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:18:04 user nova-compute[73254]:   </features>
Aug 14 15:18:04 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:18:04 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:18:04 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:18:04 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:18:04 user nova-compute[73254]:   </clock>
Aug 14 15:18:04 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:18:04 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:18:04 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:18:04 user nova-compute[73254]:   </cpu>
Aug 14 15:18:04 user nova-compute[73254]:   <devices>
Aug 14 15:18:04 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:18:04 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:18:04 user nova-compute[73254]:       <source dev="/dev/sdd"/>
Aug 14 15:18:04 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:18:04 user nova-compute[73254]:       <serial>481c1650-bf1f-4268-8d68-f7afe8c9e188</serial>
Aug 14 15:18:04 user nova-compute[73254]:     </disk>
Aug 14 15:18:04 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:18:04 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:18:04 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue"/>
Aug 14 15:18:04 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:18:04 user nova-compute[73254]:       <boot order="1"/>
Aug 14 15:18:04 user nova-compute[73254]:     </disk>
Aug 14 15:18:04 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:18:04 user nova-compute[73254]:       <mac address="fa:16:3e:a1:3e:1d"/>
Aug 14 15:18:04 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:18:04 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:18:04 user nova-compute[73254]:       <target dev="tap0d7a02f9-7e"/>
Aug 14 15:18:04 user nova-compute[73254]:     </interface>
Aug 14 15:18:04 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:18:04 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/console.log" append="off"/>
Aug 14 15:18:04 user nova-compute[73254]:     </serial>
Aug 14 15:18:04 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:18:04 user nova-compute[73254]:     <video>
Aug 14 15:18:04 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:18:04 user nova-compute[73254]:     </video>
Aug 14 15:18:04 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:18:04 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:18:04 user nova-compute[73254]:     </rng>
Aug 14 15:18:04 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:18:04 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:18:04 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:18:04 user nova-compute[73254]:     </memballoon>
Aug 14 15:18:04 user nova-compute[73254]:   </devices>
Aug 14 15:18:04 user nova-compute[73254]: </domain>
Aug 14 15:18:04 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:18:04 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Instance destroyed successfully.
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:18:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] No VIF found with MAC fa:16:3e:a1:3e:1d, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:18:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-4f3c449b-8671-4efe-b323-a392237f1546 req-573a68d7-3e86-4d19-94b9-89b1220519e3 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4f3c449b-8671-4efe-b323-a392237f1546 req-573a68d7-3e86-4d19-94b9-89b1220519e3 service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4f3c449b-8671-4efe-b323-a392237f1546 req-573a68d7-3e86-4d19-94b9-89b1220519e3 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4f3c449b-8671-4efe-b323-a392237f1546 req-573a68d7-3e86-4d19-94b9-89b1220519e3 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-4f3c449b-8671-4efe-b323-a392237f1546 req-573a68d7-3e86-4d19-94b9-89b1220519e3 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:18:06 user nova-compute[73254]: WARNING nova.compute.manager [req-4f3c449b-8671-4efe-b323-a392237f1546 req-573a68d7-3e86-4d19-94b9-89b1220519e3 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state active and task_state rescuing.
Aug 14 15:18:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:08 user nova-compute[73254]: INFO nova.compute.manager [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Terminating instance
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-6e517a94-7fef-4c96-b779-7ef2ab2d4b1c req-391f87f9-b1f2-4774-aa40-d9ad76ccb582 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6e517a94-7fef-4c96-b779-7ef2ab2d4b1c req-391f87f9-b1f2-4774-aa40-d9ad76ccb582 service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6e517a94-7fef-4c96-b779-7ef2ab2d4b1c req-391f87f9-b1f2-4774-aa40-d9ad76ccb582 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6e517a94-7fef-4c96-b779-7ef2ab2d4b1c req-391f87f9-b1f2-4774-aa40-d9ad76ccb582 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-6e517a94-7fef-4c96-b779-7ef2ab2d4b1c req-391f87f9-b1f2-4774-aa40-d9ad76ccb582 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:18:08 user nova-compute[73254]: WARNING nova.compute.manager [req-6e517a94-7fef-4c96-b779-7ef2ab2d4b1c req-391f87f9-b1f2-4774-aa40-d9ad76ccb582 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state active and task_state rescuing.
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-740ed48a-0521-461e-956b-550f878f8cf7 req-156e2dee-9f1f-4df5-b00a-d4efa412c802 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-unplugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-740ed48a-0521-461e-956b-550f878f8cf7 req-156e2dee-9f1f-4df5-b00a-d4efa412c802 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-740ed48a-0521-461e-956b-550f878f8cf7 req-156e2dee-9f1f-4df5-b00a-d4efa412c802 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-740ed48a-0521-461e-956b-550f878f8cf7 req-156e2dee-9f1f-4df5-b00a-d4efa412c802 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-740ed48a-0521-461e-956b-550f878f8cf7 req-156e2dee-9f1f-4df5-b00a-d4efa412c802 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-unplugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-740ed48a-0521-461e-956b-550f878f8cf7 req-156e2dee-9f1f-4df5-b00a-d4efa412c802 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-unplugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for 078c2370-66ff-42b3-9e41-b3b7cefed1f2 due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026288.5059001, 078c2370-66ff-42b3-9e41-b3b7cefed1f2 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:18:08 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] VM Resumed (Lifecycle Event)
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-45e1e8d9-885d-4559-9c6e-7da7ae40f40b tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:18:08 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026288.5081873, 078c2370-66ff-42b3-9e41-b3b7cefed1f2 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:18:08 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] VM Started (Lifecycle Event)
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Instance destroyed successfully.
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'resources' on Instance uuid ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:11:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1127561786',display_name='tempest-ServerRescueNegativeTestJSON-server-1127561786',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1127561786',id=32,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJ01/enepWJq3H3SausIfGJeo9LJ/hhZa7U3U1wVIQCfY1rxWTtqM3d/PbPlfrZ1LO6IxUwIFKF3OZDo8ZPQjPuy+785ttYLlFxHYREQN/0eurbTclXoLGCA9t9pZC0nw==',key_name='tempest-keypair-1666366664',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:13:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-gc5pb6d4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:15:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5200b421cc6c4e45b91f547888fb896a',uuid=ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "address": "fa:16:3e:2e:a6:b7", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap94e5c6ae-a8", "ovs_interfaceid": "94e5c6ae-a805-4ec4-b673-11aafe7f9c8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:a6:b7,bridge_name='br-int',has_traffic_filtering=True,id=94e5c6ae-a805-4ec4-b673-11aafe7f9c8d,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e5c6ae-a8') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG os_vif [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:a6:b7,bridge_name='br-int',has_traffic_filtering=True,id=94e5c6ae-a805-4ec4-b673-11aafe7f9c8d,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e5c6ae-a8') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap94e5c6ae-a8, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:18:08 user nova-compute[73254]: INFO os_vif [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:a6:b7,bridge_name='br-int',has_traffic_filtering=True,id=94e5c6ae-a805-4ec4-b673-11aafe7f9c8d,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap94e5c6ae-a8')
Aug 14 15:18:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Deleting instance files /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e_del
Aug 14 15:18:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Deletion of /opt/stack/data/nova/instances/ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e_del complete
Aug 14 15:18:09 user nova-compute[73254]: INFO nova.compute.manager [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 14 15:18:09 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:18:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-fa04c48f-2719-423c-8a10-13c1576143e4 req-2518f48c-e38c-4326-a6b8-e7d5f8a50db7 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-deleted-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:10 user nova-compute[73254]: INFO nova.compute.manager [req-fa04c48f-2719-423c-8a10-13c1576143e4 req-2518f48c-e38c-4326-a6b8-e7d5f8a50db7 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Neutron deleted interface 94e5c6ae-a805-4ec4-b673-11aafe7f9c8d; detaching it from the instance and deleting it from the info cache
Aug 14 15:18:10 user nova-compute[73254]: DEBUG nova.network.neutron [req-fa04c48f-2719-423c-8a10-13c1576143e4 req-2518f48c-e38c-4326-a6b8-e7d5f8a50db7 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:18:10 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Took 1.29 seconds to deallocate network for instance.
Aug 14 15:18:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-fa04c48f-2719-423c-8a10-13c1576143e4 req-2518f48c-e38c-4326-a6b8-e7d5f8a50db7 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Detach interface failed, port_id=94e5c6ae-a805-4ec4-b673-11aafe7f9c8d, reason: Instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-16267c93-9ad6-4669-b3f1-dd5b2ec48cf4 req-09ed61b6-744b-4fe0-b898-30505e0ff591 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16267c93-9ad6-4669-b3f1-dd5b2ec48cf4 req-09ed61b6-744b-4fe0-b898-30505e0ff591 service nova] Acquiring lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16267c93-9ad6-4669-b3f1-dd5b2ec48cf4 req-09ed61b6-744b-4fe0-b898-30505e0ff591 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-16267c93-9ad6-4669-b3f1-dd5b2ec48cf4 req-09ed61b6-744b-4fe0-b898-30505e0ff591 service nova] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-16267c93-9ad6-4669-b3f1-dd5b2ec48cf4 req-09ed61b6-744b-4fe0-b898-30505e0ff591 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] No waiting events found dispatching network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:18:10 user nova-compute[73254]: WARNING nova.compute.manager [req-16267c93-9ad6-4669-b3f1-dd5b2ec48cf4 req-09ed61b6-744b-4fe0-b898-30505e0ff591 service nova] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Received unexpected event network-vif-plugged-94e5c6ae-a805-4ec4-b673-11aafe7f9c8d for instance with vm_state deleted and task_state None.
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:18:10 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Error from libvirt while getting description of instance-00000020: [Error Code 42] Domain not found: no domain with matching uuid 'ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e' (instance-00000020): libvirt.libvirtError: Domain not found: no domain with matching uuid 'ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e' (instance-00000020)
Aug 14 15:18:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:11 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Deleted allocations for instance ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4cc998b1-c6b5-4efc-9db2-915777e06aea tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.082s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:13 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:18:13 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7844MB free_disk=24.91259765625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0578772b-534f-4d29-9b68-d9b691d339e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 078c2370-66ff-42b3-9e41-b3b7cefed1f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 5a927b8b-123f-40c7-a292-ee61f9afde9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:18:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:18:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:18:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:19 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:19 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:23 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026288.8815255, ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:18:23 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] VM Stopped (Lifecycle Event)
Aug 14 15:18:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b70002fb-8e28-4961-a290-f79ca9f2d80c None None] [instance: ed1d5834-dc6e-44a0-8e40-8b98d1ac3d7e] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:18:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:18:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:18:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:18:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:18:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:46 user nova-compute[73254]: INFO nova.compute.manager [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Terminating instance
Aug 14 15:18:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-34383f85-f905-47d6-bc23-8bea7962be9b req-7926193b-fcde-4715-9c12-b38dab619769 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received event network-vif-unplugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-34383f85-f905-47d6-bc23-8bea7962be9b req-7926193b-fcde-4715-9c12-b38dab619769 service nova] Acquiring lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-34383f85-f905-47d6-bc23-8bea7962be9b req-7926193b-fcde-4715-9c12-b38dab619769 service nova] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-34383f85-f905-47d6-bc23-8bea7962be9b req-7926193b-fcde-4715-9c12-b38dab619769 service nova] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-34383f85-f905-47d6-bc23-8bea7962be9b req-7926193b-fcde-4715-9c12-b38dab619769 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] No waiting events found dispatching network-vif-unplugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:18:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-34383f85-f905-47d6-bc23-8bea7962be9b req-7926193b-fcde-4715-9c12-b38dab619769 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received event network-vif-unplugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Instance destroyed successfully.
Aug 14 15:18:47 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lazy-loading 'resources' on Instance uuid 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:15:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1707328756',display_name='tempest-AttachVolumeNegativeTest-server-1707328756',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1707328756',id=36,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOAxXNhflyhuQF8H2J9zNypRJXUlt3qzP2weBOp4A2zM43qViau+lj4W5m852428Otva0yhrqXcAxfrbWra5oht/xFkZuFbagkmYv0RZsMzPmCk10kGLKQl8I9MwNFG/aQ==',key_name='tempest-keypair-134586040',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:15:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f209fa7e3ab40a2b5b9dc6725195d22',ramdisk_id='',reservation_id='r-wggni9fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-476210608',owner_user_name='tempest-AttachVolumeNegativeTest-476210608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:15:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ec4cf769cd15416bbbc1b9def6d12202',uuid=6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converting VIF {"id": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "address": "fa:16:3e:3b:8f:ab", "network": {"id": "b366ec9d-af96-4521-8fb2-42f4fc8f2aba", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1847073476-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f209fa7e3ab40a2b5b9dc6725195d22", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd97ed2c6-8c", "ovs_interfaceid": "d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:8f:ab,bridge_name='br-int',has_traffic_filtering=True,id=d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97ed2c6-8c') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG os_vif [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:8f:ab,bridge_name='br-int',has_traffic_filtering=True,id=d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97ed2c6-8c') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd97ed2c6-8c, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:18:47 user nova-compute[73254]: INFO os_vif [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:8f:ab,bridge_name='br-int',has_traffic_filtering=True,id=d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703,network=Network(b366ec9d-af96-4521-8fb2-42f4fc8f2aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd97ed2c6-8c')
Aug 14 15:18:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Deleting instance files /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1_del
Aug 14 15:18:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Deletion of /opt/stack/data/nova/instances/6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1_del complete
Aug 14 15:18:47 user nova-compute[73254]: INFO nova.compute.manager [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 15:18:47 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:18:47 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:18:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:48 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:18:48 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Took 1.05 seconds to deallocate network for instance.
Aug 14 15:18:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-786ba65a-76dc-4102-a294-2cbf684f0e85 req-064ae9c9-e773-4c50-9faf-017acc8f0e06 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received event network-vif-deleted-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:48 user nova-compute[73254]: INFO nova.compute.manager [req-786ba65a-76dc-4102-a294-2cbf684f0e85 req-064ae9c9-e773-4c50-9faf-017acc8f0e06 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Neutron deleted interface d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703; detaching it from the instance and deleting it from the info cache
Aug 14 15:18:48 user nova-compute[73254]: DEBUG nova.network.neutron [req-786ba65a-76dc-4102-a294-2cbf684f0e85 req-064ae9c9-e773-4c50-9faf-017acc8f0e06 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:18:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-786ba65a-76dc-4102-a294-2cbf684f0e85 req-064ae9c9-e773-4c50-9faf-017acc8f0e06 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Detach interface failed, port_id=d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703, reason: Instance 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:18:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:48 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:18:49 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:18:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-cb2fcf30-503c-477d-8478-582da4f319b6 req-cd86585a-ff2f-4633-a270-204361a154a1 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received event network-vif-plugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cb2fcf30-503c-477d-8478-582da4f319b6 req-cd86585a-ff2f-4633-a270-204361a154a1 service nova] Acquiring lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cb2fcf30-503c-477d-8478-582da4f319b6 req-cd86585a-ff2f-4633-a270-204361a154a1 service nova] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cb2fcf30-503c-477d-8478-582da4f319b6 req-cd86585a-ff2f-4633-a270-204361a154a1 service nova] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-cb2fcf30-503c-477d-8478-582da4f319b6 req-cd86585a-ff2f-4633-a270-204361a154a1 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] No waiting events found dispatching network-vif-plugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:18:49 user nova-compute[73254]: WARNING nova.compute.manager [req-cb2fcf30-503c-477d-8478-582da4f319b6 req-cd86585a-ff2f-4633-a270-204361a154a1 service nova] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Received unexpected event network-vif-plugged-d97ed2c6-8cf5-46fb-ae8f-1b2c9b51e703 for instance with vm_state deleted and task_state None.
Aug 14 15:18:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:49 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Deleted allocations for instance 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1
Aug 14 15:18:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f766e573-4727-4295-8b2d-f805da8d0461 tempest-AttachVolumeNegativeTest-476210608 tempest-AttachVolumeNegativeTest-476210608-project-member] Lock "6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.594s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received event network-changed-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Refreshing instance network info cache due to event network-changed-f088be4d-4968-414e-aca6-6594f9bc2e06. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] Acquiring lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] Acquired lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Refreshing network info cache for port f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updated VIF entry in instance network info cache for port f088be4d-4968-414e-aca6-6594f9bc2e06. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updating instance_info_cache with network_info: [{"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] Releasing lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-changed-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG nova.compute.manager [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Refreshing instance network info cache due to event network-changed-8d93b8b1-b5df-46d6-a980-29042ecf502d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] Acquiring lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] Acquired lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:18:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Refreshing network info cache for port 8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:18:52 user nova-compute[73254]: DEBUG nova.network.neutron [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updated VIF entry in instance network info cache for port 8d93b8b1-b5df-46d6-a980-29042ecf502d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:18:52 user nova-compute[73254]: DEBUG nova.network.neutron [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating instance_info_cache with network_info: [{"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:18:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-69074f52-0fea-4c5c-bb3c-e76dc90624a3 req-a6376834-d647-4136-98c2-0c7f4c815956 service nova] Releasing lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:18:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Stashing vm_state: active {{(pid=73254) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 14 15:18:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:52 user nova-compute[73254]: DEBUG nova.objects.instance [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'pci_requests' on Instance uuid 5a927b8b-123f-40c7-a292-ee61f9afde9d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:18:52 user nova-compute[73254]: INFO nova.compute.claims [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Claim successful on node user
Aug 14 15:18:52 user nova-compute[73254]: DEBUG nova.objects.instance [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'resources' on Instance uuid 5a927b8b-123f-40c7-a292-ee61f9afde9d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:52 user nova-compute[73254]: DEBUG nova.objects.instance [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a927b8b-123f-40c7-a292-ee61f9afde9d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:18:52 user nova-compute[73254]: INFO nova.compute.resource_tracker [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating resource usage from migration a506e75c-c09c-46d5-b987-f67b1888155d
Aug 14 15:18:53 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:18:53 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:18:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.466s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:53 user nova-compute[73254]: INFO nova.compute.manager [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Migrating
Aug 14 15:18:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:18:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquired lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:18:53 user nova-compute[73254]: DEBUG nova.network.neutron [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:18:53 user nova-compute[73254]: DEBUG nova.network.neutron [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating instance_info_cache with network_info: [{"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:18:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Releasing lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:18:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Starting migrate_disk_and_power_off {{(pid=73254) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 14 15:18:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-0ad93d0e-7301-4c06-bdc5-774378db5b4f req-87356a68-67d3-4b06-b516-b2df966fb817 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-vif-unplugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0ad93d0e-7301-4c06-bdc5-774378db5b4f req-87356a68-67d3-4b06-b516-b2df966fb817 service nova] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0ad93d0e-7301-4c06-bdc5-774378db5b4f req-87356a68-67d3-4b06-b516-b2df966fb817 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0ad93d0e-7301-4c06-bdc5-774378db5b4f req-87356a68-67d3-4b06-b516-b2df966fb817 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-0ad93d0e-7301-4c06-bdc5-774378db5b4f req-87356a68-67d3-4b06-b516-b2df966fb817 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] No waiting events found dispatching network-vif-unplugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:18:54 user nova-compute[73254]: WARNING nova.compute.manager [req-0ad93d0e-7301-4c06-bdc5-774378db5b4f req-87356a68-67d3-4b06-b516-b2df966fb817 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received unexpected event network-vif-unplugged-8d93b8b1-b5df-46d6-a980-29042ecf502d for instance with vm_state active and task_state resize_migrating.
Aug 14 15:18:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:54 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Instance destroyed successfully.
Aug 14 15:18:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1601224980',display_name='tempest-ServerActionsTestOtherA-server-1601224980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1601224980',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVC3LG9bN01HlSiMNZhDA0zEYEcGLDrYhPpLJz9ta218GScDSC8eEo3thhKHy7nQaAVL89N9YcF8sXNEgn/eaLjWVETDYOO04B8PSlrVv3eBig80mH0AK7hGooJqv3yA==',key_name='tempest-keypair-384224305',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:17:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-1y3gsh57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:18:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=5a927b8b-123f-40c7-a292-ee61f9afde9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1129845591-network", "vif_mac": "fa:16:3e:48:ca:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1129845591-network", "vif_mac": "fa:16:3e:48:ca:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_vif [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d93b8b1-b5, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:18:54 user nova-compute[73254]: INFO os_vif [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5')
Aug 14 15:18:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYAabuBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:18:54 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fca1156-4cd9-4314-865b-78f9129d6292]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[77422827-3c62-4d25-bff6-a6eda17fde44]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:18:54 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:18:54 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:18:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:18:54 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:18:54 user nova-compute[73254]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:18:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd668653520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[22448c03-1166-4c05-949b-7d00678c0374]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6512bfa-74a9-45c7-8138-f29d29c6155b]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf6a522-9e37-4651-b685-8ece389710b3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.108s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a1eadb-2fca-4b78-9709-e2d3daf75e2e]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea5ddb0-19ad-4519-b8d0-1f9e76b9d4e4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac1445c-a0b9-4108-b58b-1c099c4e5f62]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260]
Aug 14 15:18:54 user nova-compute[73254]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260] successful.
Aug 14 15:18:54 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ddb7e0-4b3a-4c83-85f7-8ad8d750f316]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== disconnect_volume: return (359ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:18:54 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-8957458f-952e-4ca1-8ba1-3bd699fec2dc req-9c3b89a5-7918-48f2-b25c-a8a95506d5c6 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8957458f-952e-4ca1-8ba1-3bd699fec2dc req-9c3b89a5-7918-48f2-b25c-a8a95506d5c6 service nova] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8957458f-952e-4ca1-8ba1-3bd699fec2dc req-9c3b89a5-7918-48f2-b25c-a8a95506d5c6 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8957458f-952e-4ca1-8ba1-3bd699fec2dc req-9c3b89a5-7918-48f2-b25c-a8a95506d5c6 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-8957458f-952e-4ca1-8ba1-3bd699fec2dc req-9c3b89a5-7918-48f2-b25c-a8a95506d5c6 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] No waiting events found dispatching network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:18:56 user nova-compute[73254]: WARNING nova.compute.manager [req-8957458f-952e-4ca1-8ba1-3bd699fec2dc req-9c3b89a5-7918-48f2-b25c-a8a95506d5c6 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received unexpected event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d for instance with vm_state active and task_state resize_migrating.
Aug 14 15:18:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Port 8d93b8b1-b5df-46d6-a980-29042ecf502d binding to destination host user is already ACTIVE {{(pid=73254) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquired lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:18:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG nova.network.neutron [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating instance_info_cache with network_info: [{"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Releasing lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG os_brick.utils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca841f7a-aecf-4487-a88a-ec2388b61aee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bb1cb7-d767-4f7d-aba7-efc22d77e9e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc04fba1-74c7-4a68-b99f-2edae3e0fe30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[233ffeac-00ca-47bc-acc3-7c3e2dd3472e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:18:57 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:18:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d16202-6c71-4382-bbeb-34a2837280a0]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:18:57 user nova-compute[73254]: DEBUG os_brick.utils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:18:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:18:59 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:18:59 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:18:59 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:02 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026327.447518, 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:19:02 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] VM Stopped (Lifecycle Event)
Aug 14 15:19:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3324b77d-c75e-4643-9ddc-c8c990cc5934 None None] [instance: 6e0ea8a7-345f-4bc5-9822-62d2e0c9d9b1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Starting finish_migration {{(pid=73254) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Instance directory exists: not creating {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 14 15:19:06 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Creating image(s)
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Ensure instance console log exists: /opt/stack/data/nova/instances/5a927b8b-123f-40c7-a292-ee61f9afde9d/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Start _get_guest_xml network_info=[{"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1129845591-network", "vif_mac": "fa:16:3e:48:ca:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f298d739-d57e-4bf9-a181-a771ff792aa8', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYAabuBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '5a927b8b-123f-40c7-a292-ee61f9afde9d', 'attached_at': '2023-08-14T15:19:07.000000', 'detached_at': '', 'volume_id': 'd4ea4429-9e60-4b62-adfd-2377409fddbb', 'serial': 'd4ea4429-9e60-4b62-adfd-2377409fddbb'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:19:06 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:19:06 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.objects.instance [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a927b8b-123f-40c7-a292-ee61f9afde9d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYAabuBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:19:06 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:19:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:19:06 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:19:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:19:06 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:19:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29537d2-d2d3-41a8-9468-d8c1d088333f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:19:06 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[630771de-b366-4b3e-a1e1-2efbbaf8f3cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb] added
Aug 14 15:19:06 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:19:06 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.054s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[24aeeb62-68f5-4947-ac04-b15df20bdfdc]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b1f38f-fa37-4dd4-946d-0b16d0bb7e06]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYAabuBm {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GYAabuBm" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc15129-858c-49dc-9dfa-30f69eec8819]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GYAabuBm'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8c2533-ad1f-40df-904f-5144cd8b81ae]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f386d6-42d6-4aa2-b4cb-fd244e892ff7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:19:07 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:19:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:19:07 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:19:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f45c5e9-1cf3-46d7-8d1e-f3fc5c083b7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260]
Aug 14 15:19:07 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260] successful.
Aug 14 15:19:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac91e46-58fd-4650-ac97-1f0baf258f24]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c395703d-d39d-4a37-9fe0-9196e2dd3d88]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:19:07 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:19:07 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:19:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:19:07 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:19:07 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:19:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de814cc-c89e-4ab1-b128-d040f7383a2e]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:19:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYAabuBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26335663964393464', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335663964393464', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1601224980',display_name='tempest-ServerActionsTestOtherA-server-1601224980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1601224980',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVC3LG9bN01HlSiMNZhDA0zEYEcGLDrYhPpLJz9ta218GScDSC8eEo3thhKHy7nQaAVL89N9YcF8sXNEgn/eaLjWVETDYOO04B8PSlrVv3eBig80mH0AK7hGooJqv3yA==',key_name='tempest-keypair-384224305',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:17:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-1y3gsh57',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=5a927b8b-123f-40c7-a292-ee61f9afde9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1129845591-network", "vif_mac": "fa:16:3e:48:ca:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1129845591-network", "vif_mac": "fa:16:3e:48:ca:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:19:08 user nova-compute[73254]:   <uuid>5a927b8b-123f-40c7-a292-ee61f9afde9d</uuid>
Aug 14 15:19:08 user nova-compute[73254]:   <name>instance-00000026</name>
Aug 14 15:19:08 user nova-compute[73254]:   <memory>2097152</memory>
Aug 14 15:19:08 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:19:08 user nova-compute[73254]:   <metadata>
Aug 14 15:19:08 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:19:08 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:19:08 user nova-compute[73254]:       <nova:name>tempest-ServerActionsTestOtherA-server-1601224980</nova:name>
Aug 14 15:19:08 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:19:06</nova:creationTime>
Aug 14 15:19:08 user nova-compute[73254]:       <nova:flavor name="m1.small">
Aug 14 15:19:08 user nova-compute[73254]:         <nova:memory>2048</nova:memory>
Aug 14 15:19:08 user nova-compute[73254]:         <nova:disk>20</nova:disk>
Aug 14 15:19:08 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:19:08 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:19:08 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:19:08 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:19:08 user nova-compute[73254]:       <nova:owner>
Aug 14 15:19:08 user nova-compute[73254]:         <nova:user uuid="e56bbc03d7af4dec928da4d490af7b76">tempest-ServerActionsTestOtherA-1005131430-project-member</nova:user>
Aug 14 15:19:08 user nova-compute[73254]:         <nova:project uuid="8a7dd480b32e4059b4d265a6049963e4">tempest-ServerActionsTestOtherA-1005131430</nova:project>
Aug 14 15:19:08 user nova-compute[73254]:       </nova:owner>
Aug 14 15:19:08 user nova-compute[73254]:       <nova:ports>
Aug 14 15:19:08 user nova-compute[73254]:         <nova:port uuid="8d93b8b1-b5df-46d6-a980-29042ecf502d">
Aug 14 15:19:08 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 14 15:19:08 user nova-compute[73254]:         </nova:port>
Aug 14 15:19:08 user nova-compute[73254]:       </nova:ports>
Aug 14 15:19:08 user nova-compute[73254]:     </nova:instance>
Aug 14 15:19:08 user nova-compute[73254]:   </metadata>
Aug 14 15:19:08 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:19:08 user nova-compute[73254]:     <system>
Aug 14 15:19:08 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:19:08 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:19:08 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:19:08 user nova-compute[73254]:       <entry name="serial">5a927b8b-123f-40c7-a292-ee61f9afde9d</entry>
Aug 14 15:19:08 user nova-compute[73254]:       <entry name="uuid">5a927b8b-123f-40c7-a292-ee61f9afde9d</entry>
Aug 14 15:19:08 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:19:08 user nova-compute[73254]:     </system>
Aug 14 15:19:08 user nova-compute[73254]:   </sysinfo>
Aug 14 15:19:08 user nova-compute[73254]:   <os>
Aug 14 15:19:08 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:19:08 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:19:08 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:19:08 user nova-compute[73254]:   </os>
Aug 14 15:19:08 user nova-compute[73254]:   <features>
Aug 14 15:19:08 user nova-compute[73254]:     <acpi/>
Aug 14 15:19:08 user nova-compute[73254]:     <apic/>
Aug 14 15:19:08 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:19:08 user nova-compute[73254]:   </features>
Aug 14 15:19:08 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:19:08 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:19:08 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:19:08 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:19:08 user nova-compute[73254]:   </clock>
Aug 14 15:19:08 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:19:08 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:19:08 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:19:08 user nova-compute[73254]:   </cpu>
Aug 14 15:19:08 user nova-compute[73254]:   <devices>
Aug 14 15:19:08 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:19:08 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:19:08 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 15:19:08 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:19:08 user nova-compute[73254]:       <serial>d4ea4429-9e60-4b62-adfd-2377409fddbb</serial>
Aug 14 15:19:08 user nova-compute[73254]:     </disk>
Aug 14 15:19:08 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:19:08 user nova-compute[73254]:       <mac address="fa:16:3e:48:ca:c3"/>
Aug 14 15:19:08 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:19:08 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:19:08 user nova-compute[73254]:       <target dev="tap8d93b8b1-b5"/>
Aug 14 15:19:08 user nova-compute[73254]:     </interface>
Aug 14 15:19:08 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:19:08 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/5a927b8b-123f-40c7-a292-ee61f9afde9d/console.log" append="off"/>
Aug 14 15:19:08 user nova-compute[73254]:     </serial>
Aug 14 15:19:08 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:19:08 user nova-compute[73254]:     <video>
Aug 14 15:19:08 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:19:08 user nova-compute[73254]:     </video>
Aug 14 15:19:08 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:19:08 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:19:08 user nova-compute[73254]:     </rng>
Aug 14 15:19:08 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:19:08 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:19:08 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:19:08 user nova-compute[73254]:     </memballoon>
Aug 14 15:19:08 user nova-compute[73254]:   </devices>
Aug 14 15:19:08 user nova-compute[73254]: </domain>
Aug 14 15:19:08 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1601224980',display_name='tempest-ServerActionsTestOtherA-server-1601224980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1601224980',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVC3LG9bN01HlSiMNZhDA0zEYEcGLDrYhPpLJz9ta218GScDSC8eEo3thhKHy7nQaAVL89N9YcF8sXNEgn/eaLjWVETDYOO04B8PSlrVv3eBig80mH0AK7hGooJqv3yA==',key_name='tempest-keypair-384224305',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:17:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-1y3gsh57',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:18:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=5a927b8b-123f-40c7-a292-ee61f9afde9d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1129845591-network", "vif_mac": "fa:16:3e:48:ca:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1129845591-network", "vif_mac": "fa:16:3e:48:ca:c3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG os_vif [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d93b8b1-b5, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8d93b8b1-b5, col_values=(('external_ids', {'iface-id': '8d93b8b1-b5df-46d6-a980-29042ecf502d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:ca:c3', 'vm-uuid': '5a927b8b-123f-40c7-a292-ee61f9afde9d'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:08 user nova-compute[73254]: INFO os_vif [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5')
Aug 14 15:19:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] No VIF found with MAC fa:16:3e:48:ca:c3, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026334.5634701, 5a927b8b-123f-40c7-a292-ee61f9afde9d => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:19:09 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] VM Stopped (Lifecycle Event)
Aug 14 15:19:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-9b948854-0879-45fe-be6c-99ef00221562 None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-5aa8faf0-48e0-46b3-ac5a-89d8f0ee23ae req-f92beaa4-6fde-4226-abca-9857b06d5ba6 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5aa8faf0-48e0-46b3-ac5a-89d8f0ee23ae req-f92beaa4-6fde-4226-abca-9857b06d5ba6 service nova] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5aa8faf0-48e0-46b3-ac5a-89d8f0ee23ae req-f92beaa4-6fde-4226-abca-9857b06d5ba6 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5aa8faf0-48e0-46b3-ac5a-89d8f0ee23ae req-f92beaa4-6fde-4226-abca-9857b06d5ba6 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-5aa8faf0-48e0-46b3-ac5a-89d8f0ee23ae req-f92beaa4-6fde-4226-abca-9857b06d5ba6 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] No waiting events found dispatching network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:19:09 user nova-compute[73254]: WARNING nova.compute.manager [req-5aa8faf0-48e0-46b3-ac5a-89d8f0ee23ae req-f92beaa4-6fde-4226-abca-9857b06d5ba6 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received unexpected event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d for instance with vm_state active and task_state resize_finish.
Aug 14 15:19:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:19:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:19:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026351.8710477, 5a927b8b-123f-40c7-a292-ee61f9afde9d => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:19:11 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] VM Resumed (Lifecycle Event)
Aug 14 15:19:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Acquiring lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:11 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Instance running successfully.
Aug 14 15:19:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Failed to set time: agent not configured {{(pid=73254) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-27f303c7-9cc0-494b-a53c-2e56fc506145 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] finish_migration finished successfully. {{(pid=73254) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:19:11 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:19:12 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 15:19:12 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026351.883441, 5a927b8b-123f-40c7-a292-ee61f9afde9d => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:19:12 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] VM Started (Lifecycle Event)
Aug 14 15:19:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-3171aa1e-e4ab-42ba-ac38-914c7070ac48 req-221ae713-8438-4452-916f-fa3f3bd70a08 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3171aa1e-e4ab-42ba-ac38-914c7070ac48 req-221ae713-8438-4452-916f-fa3f3bd70a08 service nova] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3171aa1e-e4ab-42ba-ac38-914c7070ac48 req-221ae713-8438-4452-916f-fa3f3bd70a08 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3171aa1e-e4ab-42ba-ac38-914c7070ac48 req-221ae713-8438-4452-916f-fa3f3bd70a08 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-3171aa1e-e4ab-42ba-ac38-914c7070ac48 req-221ae713-8438-4452-916f-fa3f3bd70a08 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] No waiting events found dispatching network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:19:12 user nova-compute[73254]: WARNING nova.compute.manager [req-3171aa1e-e4ab-42ba-ac38-914c7070ac48 req-221ae713-8438-4452-916f-fa3f3bd70a08 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received unexpected event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d for instance with vm_state active and task_state resize_finish.
Aug 14 15:19:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:19:12 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 14 15:19:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:19:12 user nova-compute[73254]: INFO nova.compute.claims [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Claim successful on node user
Aug 14 15:19:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:19:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:19:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8072MB free_disk=24.963375091552734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:19:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.411s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:19:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Applying migration context for instance 5a927b8b-123f-40c7-a292-ee61f9afde9d as it has an incoming, in-progress migration a506e75c-c09c-46d5-b987-f67b1888155d. Migration status is finished {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 15:19:13 user nova-compute[73254]: INFO nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating resource usage from migration a506e75c-c09c-46d5-b987-f67b1888155d
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 52930af7-b452-4bff-a8cb-7e7859f99af6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0578772b-534f-4d29-9b68-d9b691d339e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 078c2370-66ff-42b3-9e41-b3b7cefed1f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Migration a506e75c-c09c-46d5-b987-f67b1888155d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 5a927b8b-123f-40c7-a292-ee61f9afde9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 052ee1d6-85bb-4d57-b014-ed5d3edab2aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:19:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Creating image(s)
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Acquiring lock "/opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "/opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "/opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.policy [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e18336c692194d47a755f3df8b90a767', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a543232c78ef4404b2e2ff2574b6ec0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.203s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk 1073741824" returned: 0 in 0.053s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Checking if we can resize image /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:19:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:19:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:19:14 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Cannot resize image /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:19:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lazy-loading 'migration_context' on Instance uuid 052ee1d6-85bb-4d57-b014-ed5d3edab2aa {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:19:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:19:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Ensure instance console log exists: /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:19:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Successfully created port: c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Successfully updated port: c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Acquiring lock "refresh_cache-052ee1d6-85bb-4d57-b014-ed5d3edab2aa" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Acquired lock "refresh_cache-052ee1d6-85bb-4d57-b014-ed5d3edab2aa" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-bc897307-6102-419d-b312-6214aedc1d9e req-f2769113-bc41-4f9b-b59d-80fa4437181d service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Received event network-changed-c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-bc897307-6102-419d-b312-6214aedc1d9e req-f2769113-bc41-4f9b-b59d-80fa4437181d service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Refreshing instance network info cache due to event network-changed-c8afcc68-8e70-4968-a9bf-23cecac77f87. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bc897307-6102-419d-b312-6214aedc1d9e req-f2769113-bc41-4f9b-b59d-80fa4437181d service nova] Acquiring lock "refresh_cache-052ee1d6-85bb-4d57-b014-ed5d3edab2aa" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Updating instance_info_cache with network_info: [{"id": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "address": "fa:16:3e:98:44:ad", "network": {"id": "86494682-2e87-472a-94a2-30c82c1a772f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a8bcb64fb6d84e019592c26b7626e3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8afcc68-8e", "ovs_interfaceid": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Releasing lock "refresh_cache-052ee1d6-85bb-4d57-b014-ed5d3edab2aa" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Instance network_info: |[{"id": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "address": "fa:16:3e:98:44:ad", "network": {"id": "86494682-2e87-472a-94a2-30c82c1a772f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a8bcb64fb6d84e019592c26b7626e3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8afcc68-8e", "ovs_interfaceid": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bc897307-6102-419d-b312-6214aedc1d9e req-f2769113-bc41-4f9b-b59d-80fa4437181d service nova] Acquired lock "refresh_cache-052ee1d6-85bb-4d57-b014-ed5d3edab2aa" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.neutron [req-bc897307-6102-419d-b312-6214aedc1d9e req-f2769113-bc41-4f9b-b59d-80fa4437181d service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Refreshing network info cache for port c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Start _get_guest_xml network_info=[{"id": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "address": "fa:16:3e:98:44:ad", "network": {"id": "86494682-2e87-472a-94a2-30c82c1a772f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a8bcb64fb6d84e019592c26b7626e3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8afcc68-8e", "ovs_interfaceid": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:19:15 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:19:15 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:19:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1125758023',display_name='tempest-VolumesNegativeTest-instance-1125758023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1125758023',id=39,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a543232c78ef4404b2e2ff2574b6ec0e',ramdisk_id='',reservation_id='r-6uqwn0de',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2048836891',owner_user_name='tempest-VolumesNegativeTest-2048836891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:19:13Z,user_data=None,user_id='e18336c692194d47a755f3df8b90a767',uuid=052ee1d6-85bb-4d57-b014-ed5d3edab2aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "address": "fa:16:3e:98:44:ad", "network": {"id": "86494682-2e87-472a-94a2-30c82c1a772f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a8bcb64fb6d84e019592c26b7626e3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8afcc68-8e", "ovs_interfaceid": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Converting VIF {"id": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "address": "fa:16:3e:98:44:ad", "network": {"id": "86494682-2e87-472a-94a2-30c82c1a772f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a8bcb64fb6d84e019592c26b7626e3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8afcc68-8e", "ovs_interfaceid": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:ad,bridge_name='br-int',has_traffic_filtering=True,id=c8afcc68-8e70-4968-a9bf-23cecac77f87,network=Network(86494682-2e87-472a-94a2-30c82c1a772f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8afcc68-8e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lazy-loading 'pci_devices' on Instance uuid 052ee1d6-85bb-4d57-b014-ed5d3edab2aa {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:19:15 user nova-compute[73254]:   <uuid>052ee1d6-85bb-4d57-b014-ed5d3edab2aa</uuid>
Aug 14 15:19:15 user nova-compute[73254]:   <name>instance-00000027</name>
Aug 14 15:19:15 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:19:15 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:19:15 user nova-compute[73254]:   <metadata>
Aug 14 15:19:15 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:19:15 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:19:15 user nova-compute[73254]:       <nova:name>tempest-VolumesNegativeTest-instance-1125758023</nova:name>
Aug 14 15:19:15 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:19:15</nova:creationTime>
Aug 14 15:19:15 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:19:15 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:19:15 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:19:15 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:19:15 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:19:15 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:19:15 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:19:15 user nova-compute[73254]:       <nova:owner>
Aug 14 15:19:15 user nova-compute[73254]:         <nova:user uuid="e18336c692194d47a755f3df8b90a767">tempest-VolumesNegativeTest-2048836891-project-member</nova:user>
Aug 14 15:19:15 user nova-compute[73254]:         <nova:project uuid="a543232c78ef4404b2e2ff2574b6ec0e">tempest-VolumesNegativeTest-2048836891</nova:project>
Aug 14 15:19:15 user nova-compute[73254]:       </nova:owner>
Aug 14 15:19:15 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:19:15 user nova-compute[73254]:       <nova:ports>
Aug 14 15:19:15 user nova-compute[73254]:         <nova:port uuid="c8afcc68-8e70-4968-a9bf-23cecac77f87">
Aug 14 15:19:15 user nova-compute[73254]:           <nova:ip type="fixed" address="192.168.233.208" ipVersion="4"/>
Aug 14 15:19:15 user nova-compute[73254]:         </nova:port>
Aug 14 15:19:15 user nova-compute[73254]:       </nova:ports>
Aug 14 15:19:15 user nova-compute[73254]:     </nova:instance>
Aug 14 15:19:15 user nova-compute[73254]:   </metadata>
Aug 14 15:19:15 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:19:15 user nova-compute[73254]:     <system>
Aug 14 15:19:15 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:19:15 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:19:15 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:19:15 user nova-compute[73254]:       <entry name="serial">052ee1d6-85bb-4d57-b014-ed5d3edab2aa</entry>
Aug 14 15:19:15 user nova-compute[73254]:       <entry name="uuid">052ee1d6-85bb-4d57-b014-ed5d3edab2aa</entry>
Aug 14 15:19:15 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:19:15 user nova-compute[73254]:     </system>
Aug 14 15:19:15 user nova-compute[73254]:   </sysinfo>
Aug 14 15:19:15 user nova-compute[73254]:   <os>
Aug 14 15:19:15 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:19:15 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:19:15 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:19:15 user nova-compute[73254]:   </os>
Aug 14 15:19:15 user nova-compute[73254]:   <features>
Aug 14 15:19:15 user nova-compute[73254]:     <acpi/>
Aug 14 15:19:15 user nova-compute[73254]:     <apic/>
Aug 14 15:19:15 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:19:15 user nova-compute[73254]:   </features>
Aug 14 15:19:15 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:19:15 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:19:15 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:19:15 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:19:15 user nova-compute[73254]:   </clock>
Aug 14 15:19:15 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:19:15 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:19:15 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:19:15 user nova-compute[73254]:   </cpu>
Aug 14 15:19:15 user nova-compute[73254]:   <devices>
Aug 14 15:19:15 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:19:15 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:19:15 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk"/>
Aug 14 15:19:15 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:19:15 user nova-compute[73254]:     </disk>
Aug 14 15:19:15 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:19:15 user nova-compute[73254]:       <mac address="fa:16:3e:98:44:ad"/>
Aug 14 15:19:15 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:19:15 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:19:15 user nova-compute[73254]:       <target dev="tapc8afcc68-8e"/>
Aug 14 15:19:15 user nova-compute[73254]:     </interface>
Aug 14 15:19:15 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:19:15 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/console.log" append="off"/>
Aug 14 15:19:15 user nova-compute[73254]:     </serial>
Aug 14 15:19:15 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:19:15 user nova-compute[73254]:     <video>
Aug 14 15:19:15 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:19:15 user nova-compute[73254]:     </video>
Aug 14 15:19:15 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:19:15 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:19:15 user nova-compute[73254]:     </rng>
Aug 14 15:19:15 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:19:15 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:19:15 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:19:15 user nova-compute[73254]:     </memballoon>
Aug 14 15:19:15 user nova-compute[73254]:   </devices>
Aug 14 15:19:15 user nova-compute[73254]: </domain>
Aug 14 15:19:15 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:19:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1125758023',display_name='tempest-VolumesNegativeTest-instance-1125758023',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1125758023',id=39,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a543232c78ef4404b2e2ff2574b6ec0e',ramdisk_id='',reservation_id='r-6uqwn0de',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2048836891',owner_user_name='tempest-VolumesNegativeTest-2048836891-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:19:13Z,user_data=None,user_id='e18336c692194d47a755f3df8b90a767',uuid=052ee1d6-85bb-4d57-b014-ed5d3edab2aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "address": "fa:16:3e:98:44:ad", "network": {"id": "86494682-2e87-472a-94a2-30c82c1a772f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a8bcb64fb6d84e019592c26b7626e3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8afcc68-8e", "ovs_interfaceid": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Converting VIF {"id": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "address": "fa:16:3e:98:44:ad", "network": {"id": "86494682-2e87-472a-94a2-30c82c1a772f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a8bcb64fb6d84e019592c26b7626e3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8afcc68-8e", "ovs_interfaceid": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:ad,bridge_name='br-int',has_traffic_filtering=True,id=c8afcc68-8e70-4968-a9bf-23cecac77f87,network=Network(86494682-2e87-472a-94a2-30c82c1a772f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8afcc68-8e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG os_vif [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:ad,bridge_name='br-int',has_traffic_filtering=True,id=c8afcc68-8e70-4968-a9bf-23cecac77f87,network=Network(86494682-2e87-472a-94a2-30c82c1a772f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8afcc68-8e') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8afcc68-8e, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8afcc68-8e, col_values=(('external_ids', {'iface-id': 'c8afcc68-8e70-4968-a9bf-23cecac77f87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:44:ad', 'vm-uuid': '052ee1d6-85bb-4d57-b014-ed5d3edab2aa'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:15 user nova-compute[73254]: INFO os_vif [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:ad,bridge_name='br-int',has_traffic_filtering=True,id=c8afcc68-8e70-4968-a9bf-23cecac77f87,network=Network(86494682-2e87-472a-94a2-30c82c1a772f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8afcc68-8e')
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] No VIF found with MAC fa:16:3e:98:44:ad, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.neutron [req-bc897307-6102-419d-b312-6214aedc1d9e req-f2769113-bc41-4f9b-b59d-80fa4437181d service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Updated VIF entry in instance network info cache for port c8afcc68-8e70-4968-a9bf-23cecac77f87. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG nova.network.neutron [req-bc897307-6102-419d-b312-6214aedc1d9e req-f2769113-bc41-4f9b-b59d-80fa4437181d service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Updating instance_info_cache with network_info: [{"id": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "address": "fa:16:3e:98:44:ad", "network": {"id": "86494682-2e87-472a-94a2-30c82c1a772f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a8bcb64fb6d84e019592c26b7626e3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8afcc68-8e", "ovs_interfaceid": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:19:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bc897307-6102-419d-b312-6214aedc1d9e req-f2769113-bc41-4f9b-b59d-80fa4437181d service nova] Releasing lock "refresh_cache-052ee1d6-85bb-4d57-b014-ed5d3edab2aa" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:19:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:19:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:19:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:19:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-5b1c32a8-1750-43dd-848a-a7b460edde0c req-e2c9d2e9-1b40-4d4c-a06d-d88624b54046 service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Received event network-vif-plugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5b1c32a8-1750-43dd-848a-a7b460edde0c req-e2c9d2e9-1b40-4d4c-a06d-d88624b54046 service nova] Acquiring lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5b1c32a8-1750-43dd-848a-a7b460edde0c req-e2c9d2e9-1b40-4d4c-a06d-d88624b54046 service nova] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5b1c32a8-1750-43dd-848a-a7b460edde0c req-e2c9d2e9-1b40-4d4c-a06d-d88624b54046 service nova] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-5b1c32a8-1750-43dd-848a-a7b460edde0c req-e2c9d2e9-1b40-4d4c-a06d-d88624b54046 service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] No waiting events found dispatching network-vif-plugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:19:17 user nova-compute[73254]: WARNING nova.compute.manager [req-5b1c32a8-1750-43dd-848a-a7b460edde0c req-e2c9d2e9-1b40-4d4c-a06d-d88624b54046 service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Received unexpected event network-vif-plugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 for instance with vm_state building and task_state spawning.
Aug 14 15:19:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Skipping network cache update for instance because it is Building. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:19:17 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:18 user nova-compute[73254]: INFO nova.compute.manager [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Terminating instance
Aug 14 15:19:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updating instance_info_cache with network_info: [{"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-81ebd5b0-2b15-4dcd-801f-12f89938794c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-2c6ff916-b34e-4381-89d4-f23bc0c3d788 req-a3836532-021f-40a7-9b9e-d228be170862 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-vif-unplugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2c6ff916-b34e-4381-89d4-f23bc0c3d788 req-a3836532-021f-40a7-9b9e-d228be170862 service nova] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2c6ff916-b34e-4381-89d4-f23bc0c3d788 req-a3836532-021f-40a7-9b9e-d228be170862 service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-2c6ff916-b34e-4381-89d4-f23bc0c3d788 req-a3836532-021f-40a7-9b9e-d228be170862 service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-2c6ff916-b34e-4381-89d4-f23bc0c3d788 req-a3836532-021f-40a7-9b9e-d228be170862 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] No waiting events found dispatching network-vif-unplugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-2c6ff916-b34e-4381-89d4-f23bc0c3d788 req-a3836532-021f-40a7-9b9e-d228be170862 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-vif-unplugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:19:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Instance destroyed successfully.
Aug 14 15:19:18 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'resources' on Instance uuid 52930af7-b452-4bff-a8cb-7e7859f99af6 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:02:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1498207160',display_name='tempest-ServerRescueNegativeTestJSON-server-1498207160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1498207160',id=17,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:04:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-nidiuaun',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:04:51Z,user_data=None,user_id='5200b421cc6c4e45b91f547888fb896a',uuid=52930af7-b452-4bff-a8cb-7e7859f99af6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "address": "fa:16:3e:24:39:49", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61ad42be-87", "ovs_interfaceid": "61ad42be-874d-4f4f-84e4-b51b6c4a208e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:39:49,bridge_name='br-int',has_traffic_filtering=True,id=61ad42be-874d-4f4f-84e4-b51b6c4a208e,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ad42be-87') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG os_vif [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:39:49,bridge_name='br-int',has_traffic_filtering=True,id=61ad42be-874d-4f4f-84e4-b51b6c4a208e,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ad42be-87') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61ad42be-87, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:19:18 user nova-compute[73254]: INFO os_vif [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:39:49,bridge_name='br-int',has_traffic_filtering=True,id=61ad42be-874d-4f4f-84e4-b51b6c4a208e,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61ad42be-87')
Aug 14 15:19:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Deleting instance files /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6_del
Aug 14 15:19:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Deletion of /opt/stack/data/nova/instances/52930af7-b452-4bff-a8cb-7e7859f99af6_del complete
Aug 14 15:19:19 user nova-compute[73254]: INFO nova.compute.manager [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Took 0.77 seconds to destroy the instance on the hypervisor.
Aug 14 15:19:19 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026359.3391576, 052ee1d6-85bb-4d57-b014-ed5d3edab2aa => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:19:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] VM Resumed (Lifecycle Event)
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:19:19 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Instance spawned successfully.
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:19:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026359.3392663, 052ee1d6-85bb-4d57-b014-ed5d3edab2aa => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:19:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] VM Started (Lifecycle Event)
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-09167936-7ef9-4b8a-8565-6ea9da6a6d35 req-56cb9735-4f8e-4ef4-9ad9-70d531bd3c98 service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Received event network-vif-plugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-09167936-7ef9-4b8a-8565-6ea9da6a6d35 req-56cb9735-4f8e-4ef4-9ad9-70d531bd3c98 service nova] Acquiring lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-09167936-7ef9-4b8a-8565-6ea9da6a6d35 req-56cb9735-4f8e-4ef4-9ad9-70d531bd3c98 service nova] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-09167936-7ef9-4b8a-8565-6ea9da6a6d35 req-56cb9735-4f8e-4ef4-9ad9-70d531bd3c98 service nova] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-09167936-7ef9-4b8a-8565-6ea9da6a6d35 req-56cb9735-4f8e-4ef4-9ad9-70d531bd3c98 service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] No waiting events found dispatching network-vif-plugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:19:19 user nova-compute[73254]: WARNING nova.compute.manager [req-09167936-7ef9-4b8a-8565-6ea9da6a6d35 req-56cb9735-4f8e-4ef4-9ad9-70d531bd3c98 service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Received unexpected event network-vif-plugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 for instance with vm_state building and task_state spawning.
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:19:19 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:19:19 user nova-compute[73254]: INFO nova.compute.manager [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Took 6.28 seconds to spawn the instance on the hypervisor.
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:19:19 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Took 0.54 seconds to deallocate network for instance.
Aug 14 15:19:19 user nova-compute[73254]: INFO nova.compute.manager [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Took 7.49 seconds to build instance.
Aug 14 15:19:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e44977bf-2036-4e6e-9a90-aba559dcdaa1 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.644s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:19:19 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:19:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:20 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Deleted allocations for instance 52930af7-b452-4bff-a8cb-7e7859f99af6
Aug 14 15:19:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f2163c9b-fcb9-40eb-88b8-11a8d8c9b101 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.987s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-fa8afb79-580a-4565-b31d-d5a170afe8f9 req-b92040d6-cd7b-4a59-815c-14e141b351b2 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fa8afb79-580a-4565-b31d-d5a170afe8f9 req-b92040d6-cd7b-4a59-815c-14e141b351b2 service nova] Acquiring lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fa8afb79-580a-4565-b31d-d5a170afe8f9 req-b92040d6-cd7b-4a59-815c-14e141b351b2 service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fa8afb79-580a-4565-b31d-d5a170afe8f9 req-b92040d6-cd7b-4a59-815c-14e141b351b2 service nova] Lock "52930af7-b452-4bff-a8cb-7e7859f99af6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-fa8afb79-580a-4565-b31d-d5a170afe8f9 req-b92040d6-cd7b-4a59-815c-14e141b351b2 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] No waiting events found dispatching network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:19:20 user nova-compute[73254]: WARNING nova.compute.manager [req-fa8afb79-580a-4565-b31d-d5a170afe8f9 req-b92040d6-cd7b-4a59-815c-14e141b351b2 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received unexpected event network-vif-plugged-61ad42be-874d-4f4f-84e4-b51b6c4a208e for instance with vm_state deleted and task_state None.
Aug 14 15:19:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-fa8afb79-580a-4565-b31d-d5a170afe8f9 req-b92040d6-cd7b-4a59-815c-14e141b351b2 service nova] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Received event network-vif-deleted-61ad42be-874d-4f4f-84e4-b51b6c4a208e {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:19:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:33 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026358.9038665, 52930af7-b452-4bff-a8cb-7e7859f99af6 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:19:33 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] VM Stopped (Lifecycle Event)
Aug 14 15:19:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-55b7c664-2824-45a8-a161-096df8124507 None None] [instance: 52930af7-b452-4bff-a8cb-7e7859f99af6] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:51 user nova-compute[73254]: INFO nova.compute.manager [None req-78b7ad2a-d0c7-4d63-9a32-0fe62b6f8885 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Unrescuing
Aug 14 15:19:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-78b7ad2a-d0c7-4d63-9a32-0fe62b6f8885 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:19:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-78b7ad2a-d0c7-4d63-9a32-0fe62b6f8885 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquired lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:19:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-78b7ad2a-d0c7-4d63-9a32-0fe62b6f8885 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:19:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-78b7ad2a-d0c7-4d63-9a32-0fe62b6f8885 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Updating instance_info_cache with network_info: [{"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:19:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-78b7ad2a-d0c7-4d63-9a32-0fe62b6f8885 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Releasing lock "refresh_cache-078c2370-66ff-42b3-9e41-b3b7cefed1f2" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:19:51 user nova-compute[73254]: DEBUG nova.objects.instance [None req-78b7ad2a-d0c7-4d63-9a32-0fe62b6f8885 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'flavor' on Instance uuid 078c2370-66ff-42b3-9e41-b3b7cefed1f2 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:19:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-a53d8991-d537-4aba-bdb8-122dae1ff9fc req-f70ac31b-08d3-4782-863b-2b2d653b5669 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-unplugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a53d8991-d537-4aba-bdb8-122dae1ff9fc req-f70ac31b-08d3-4782-863b-2b2d653b5669 service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a53d8991-d537-4aba-bdb8-122dae1ff9fc req-f70ac31b-08d3-4782-863b-2b2d653b5669 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a53d8991-d537-4aba-bdb8-122dae1ff9fc req-f70ac31b-08d3-4782-863b-2b2d653b5669 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-a53d8991-d537-4aba-bdb8-122dae1ff9fc req-f70ac31b-08d3-4782-863b-2b2d653b5669 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-unplugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:19:52 user nova-compute[73254]: WARNING nova.compute.manager [req-a53d8991-d537-4aba-bdb8-122dae1ff9fc req-f70ac31b-08d3-4782-863b-2b2d653b5669 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-unplugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:19:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:52 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Instance destroyed successfully.
Aug 14 15:19:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:19:54 user nova-compute[73254]: WARNING nova.compute.manager [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:19:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:54 user nova-compute[73254]: DEBUG nova.compute.manager [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:19:54 user nova-compute[73254]: WARNING nova.compute.manager [req-b2a2f5af-3ab9-42d4-80d6-ec06e24eb191 req-b70c7c11-7a5a-4199-b04d-327e62716f8c service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state rescued and task_state unrescuing.
Aug 14 15:19:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Removed pending event for 078c2370-66ff-42b3-9e41-b3b7cefed1f2 due to event {{(pid=73254) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 14 15:19:55 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026395.9040596, 078c2370-66ff-42b3-9e41-b3b7cefed1f2 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:19:55 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] VM Resumed (Lifecycle Event)
Aug 14 15:19:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-78b7ad2a-d0c7-4d63-9a32-0fe62b6f8885 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:19:55 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 14 15:19:55 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026395.9071913, 078c2370-66ff-42b3-9e41-b3b7cefed1f2 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:19:55 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] VM Started (Lifecycle Event)
Aug 14 15:19:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:19:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:19:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-c854b510-d5d2-4b7d-bd7b-cb358fe3a048 req-73f11de0-6ede-4324-974b-d1e82ffe2333 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:19:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c854b510-d5d2-4b7d-bd7b-cb358fe3a048 req-73f11de0-6ede-4324-974b-d1e82ffe2333 service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:19:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c854b510-d5d2-4b7d-bd7b-cb358fe3a048 req-73f11de0-6ede-4324-974b-d1e82ffe2333 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:19:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c854b510-d5d2-4b7d-bd7b-cb358fe3a048 req-73f11de0-6ede-4324-974b-d1e82ffe2333 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:19:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-c854b510-d5d2-4b7d-bd7b-cb358fe3a048 req-73f11de0-6ede-4324-974b-d1e82ffe2333 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:19:56 user nova-compute[73254]: WARNING nova.compute.manager [req-c854b510-d5d2-4b7d-bd7b-cb358fe3a048 req-73f11de0-6ede-4324-974b-d1e82ffe2333 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state active and task_state None.
Aug 14 15:19:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:19:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:20:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:20:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:20:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:20:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:20:07 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:20:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:20:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:20:08 user nova-compute[73254]: INFO nova.compute.manager [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Terminating instance
Aug 14 15:20:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-3eae7b81-8951-43fc-8722-2c782f31533f req-20475787-5e11-4142-be3c-29c53f697ccf service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-unplugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3eae7b81-8951-43fc-8722-2c782f31533f req-20475787-5e11-4142-be3c-29c53f697ccf service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3eae7b81-8951-43fc-8722-2c782f31533f req-20475787-5e11-4142-be3c-29c53f697ccf service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3eae7b81-8951-43fc-8722-2c782f31533f req-20475787-5e11-4142-be3c-29c53f697ccf service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-3eae7b81-8951-43fc-8722-2c782f31533f req-20475787-5e11-4142-be3c-29c53f697ccf service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-unplugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG nova.compute.manager [req-3eae7b81-8951-43fc-8722-2c782f31533f req-20475787-5e11-4142-be3c-29c53f697ccf service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-unplugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:20:09 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Instance destroyed successfully.
Aug 14 15:20:09 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lazy-loading 'resources' on Instance uuid 81ebd5b0-2b15-4dcd-801f-12f89938794c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:02:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1369978089',display_name='tempest-ServerRescueNegativeTestJSON-server-1369978089',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1369978089',id=16,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:07:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='977830faf2af42dd8be28808611d8d16',ramdisk_id='',reservation_id='r-tzspyfap',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-324663021',owner_user_name='tempest-ServerRescueNegativeTestJSON-324663021-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:09:40Z,user_data=None,user_id='5200b421cc6c4e45b91f547888fb896a',uuid=81ebd5b0-2b15-4dcd-801f-12f89938794c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converting VIF {"id": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "address": "fa:16:3e:7d:b8:78", "network": {"id": "fa286800-3a96-4b46-aa56-aa1765595c63", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-105736348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "977830faf2af42dd8be28808611d8d16", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e9c554c-79", "ovs_interfaceid": "8e9c554c-79a1-4ed6-9be6-c168ff494302", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=8e9c554c-79a1-4ed6-9be6-c168ff494302,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9c554c-79') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG os_vif [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=8e9c554c-79a1-4ed6-9be6-c168ff494302,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9c554c-79') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e9c554c-79, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:20:09 user nova-compute[73254]: INFO os_vif [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:b8:78,bridge_name='br-int',has_traffic_filtering=True,id=8e9c554c-79a1-4ed6-9be6-c168ff494302,network=Network(fa286800-3a96-4b46-aa56-aa1765595c63),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e9c554c-79')
Aug 14 15:20:09 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Deleting instance files /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c_del
Aug 14 15:20:09 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Deletion of /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c_del complete
Aug 14 15:20:09 user nova-compute[73254]: INFO nova.compute.manager [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json" returned: 1 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:20:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk --force-share --output=json' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:20:09 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000010, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/81ebd5b0-2b15-4dcd-801f-12f89938794c/disk
Aug 14 15:20:10 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:20:10 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7808MB free_disk=24.953147888183594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Applying migration context for instance 5a927b8b-123f-40c7-a292-ee61f9afde9d as it has an incoming, in-progress migration a506e75c-c09c-46d5-b987-f67b1888155d. Migration status is finished {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 14 15:20:10 user nova-compute[73254]: INFO nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating resource usage from migration a506e75c-c09c-46d5-b987-f67b1888155d
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0578772b-534f-4d29-9b68-d9b691d339e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 078c2370-66ff-42b3-9e41-b3b7cefed1f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Migration a506e75c-c09c-46d5-b987-f67b1888155d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 5a927b8b-123f-40c7-a292-ee61f9afde9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 052ee1d6-85bb-4d57-b014-ed5d3edab2aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:20:10 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Took 0.83 seconds to deallocate network for instance.
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-605eaa65-ce6a-4261-b83c-e243b994f1e2 req-907ab99e-a701-4a59-afea-a114dff3ba08 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-deleted-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:20:10 user nova-compute[73254]: INFO nova.compute.manager [req-605eaa65-ce6a-4261-b83c-e243b994f1e2 req-907ab99e-a701-4a59-afea-a114dff3ba08 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Neutron deleted interface 8e9c554c-79a1-4ed6-9be6-c168ff494302; detaching it from the instance and deleting it from the info cache
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.network.neutron [req-605eaa65-ce6a-4261-b83c-e243b994f1e2 req-907ab99e-a701-4a59-afea-a114dff3ba08 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-605eaa65-ce6a-4261-b83c-e243b994f1e2 req-907ab99e-a701-4a59-afea-a114dff3ba08 service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Detach interface failed, port_id=8e9c554c-79a1-4ed6-9be6-c168ff494302, reason: Instance 81ebd5b0-2b15-4dcd-801f-12f89938794c could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.019s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:20:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:20:10 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Deleted allocations for instance 81ebd5b0-2b15-4dcd-801f-12f89938794c
Aug 14 15:20:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c6919923-6897-4959-9d52-a9b275c06189 tempest-ServerRescueNegativeTestJSON-324663021 tempest-ServerRescueNegativeTestJSON-324663021-project-member] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.285s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:20:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-569b3a44-ba7b-4bad-9b85-29145a9b1e75 req-0c45635a-49e0-4a43-9091-33f2ff2a3d5f service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:20:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-569b3a44-ba7b-4bad-9b85-29145a9b1e75 req-0c45635a-49e0-4a43-9091-33f2ff2a3d5f service nova] Acquiring lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:20:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-569b3a44-ba7b-4bad-9b85-29145a9b1e75 req-0c45635a-49e0-4a43-9091-33f2ff2a3d5f service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:20:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-569b3a44-ba7b-4bad-9b85-29145a9b1e75 req-0c45635a-49e0-4a43-9091-33f2ff2a3d5f service nova] Lock "81ebd5b0-2b15-4dcd-801f-12f89938794c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:20:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-569b3a44-ba7b-4bad-9b85-29145a9b1e75 req-0c45635a-49e0-4a43-9091-33f2ff2a3d5f service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] No waiting events found dispatching network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:20:11 user nova-compute[73254]: WARNING nova.compute.manager [req-569b3a44-ba7b-4bad-9b85-29145a9b1e75 req-0c45635a-49e0-4a43-9091-33f2ff2a3d5f service nova] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Received unexpected event network-vif-plugged-8e9c554c-79a1-4ed6-9be6-c168ff494302 for instance with vm_state deleted and task_state None.
Aug 14 15:20:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:20:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:20:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:20:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:20:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:20:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:20:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Updating instance_info_cache with network_info: [{"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:20:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-c3816901-3f73-4e5c-b078-a7e78d52ef3d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:20:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:20:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:20:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:20:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:20:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:20:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:20:19 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:20:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:20:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:20:24 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026409.5619648, 81ebd5b0-2b15-4dcd-801f-12f89938794c => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:20:24 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] VM Stopped (Lifecycle Event)
Aug 14 15:20:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b202508f-74a9-4674-9cc3-216bb21599ae None None] [instance: 81ebd5b0-2b15-4dcd-801f-12f89938794c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:20:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:20:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:20:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:20:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:20:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Going to confirm migration 2 {{(pid=73254) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquired lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG nova.network.neutron [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'info_cache' on Instance uuid 5a927b8b-123f-40c7-a292-ee61f9afde9d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG nova.network.neutron [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating instance_info_cache with network_info: [{"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Releasing lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'migration_context' on Instance uuid 5a927b8b-123f-40c7-a292-ee61f9afde9d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:20:42 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:20:43 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:20:43 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:20:43 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:20:43 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:20:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.507s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:20:43 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Deleted allocation for migration a506e75c-c09c-46d5-b987-f67b1888155d
Aug 14 15:20:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-dbc9fe48-645c-48cd-90b7-5bba0800ccc6 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.549s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:20:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:20:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:20:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Acquiring lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Acquiring lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:02 user nova-compute[73254]: INFO nova.compute.manager [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Terminating instance
Aug 14 15:21:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-0cafc1e4-a751-445a-a01d-3599a4995392 req-748aeb15-178c-4fae-899d-6d68d5cfa63a service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Received event network-vif-unplugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0cafc1e4-a751-445a-a01d-3599a4995392 req-748aeb15-178c-4fae-899d-6d68d5cfa63a service nova] Acquiring lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0cafc1e4-a751-445a-a01d-3599a4995392 req-748aeb15-178c-4fae-899d-6d68d5cfa63a service nova] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0cafc1e4-a751-445a-a01d-3599a4995392 req-748aeb15-178c-4fae-899d-6d68d5cfa63a service nova] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-0cafc1e4-a751-445a-a01d-3599a4995392 req-748aeb15-178c-4fae-899d-6d68d5cfa63a service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] No waiting events found dispatching network-vif-unplugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:21:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-0cafc1e4-a751-445a-a01d-3599a4995392 req-748aeb15-178c-4fae-899d-6d68d5cfa63a service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Received event network-vif-unplugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Instance destroyed successfully.
Aug 14 15:21:03 user nova-compute[73254]: DEBUG nova.objects.instance [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lazy-loading 'resources' on Instance uuid 052ee1d6-85bb-4d57-b014-ed5d3edab2aa {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:19:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1125758023',display_name='tempest-VolumesNegativeTest-instance-1125758023',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1125758023',id=39,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:19:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a543232c78ef4404b2e2ff2574b6ec0e',ramdisk_id='',reservation_id='r-6uqwn0de',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2048836891',owner_user_name='tempest-VolumesNegativeTest-2048836891-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:19:20Z,user_data=None,user_id='e18336c692194d47a755f3df8b90a767',uuid=052ee1d6-85bb-4d57-b014-ed5d3edab2aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "address": "fa:16:3e:98:44:ad", "network": {"id": "86494682-2e87-472a-94a2-30c82c1a772f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a8bcb64fb6d84e019592c26b7626e3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8afcc68-8e", "ovs_interfaceid": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Converting VIF {"id": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "address": "fa:16:3e:98:44:ad", "network": {"id": "86494682-2e87-472a-94a2-30c82c1a772f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.208", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a8bcb64fb6d84e019592c26b7626e3e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8afcc68-8e", "ovs_interfaceid": "c8afcc68-8e70-4968-a9bf-23cecac77f87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:ad,bridge_name='br-int',has_traffic_filtering=True,id=c8afcc68-8e70-4968-a9bf-23cecac77f87,network=Network(86494682-2e87-472a-94a2-30c82c1a772f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8afcc68-8e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG os_vif [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:ad,bridge_name='br-int',has_traffic_filtering=True,id=c8afcc68-8e70-4968-a9bf-23cecac77f87,network=Network(86494682-2e87-472a-94a2-30c82c1a772f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8afcc68-8e') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8afcc68-8e, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:21:03 user nova-compute[73254]: INFO os_vif [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:44:ad,bridge_name='br-int',has_traffic_filtering=True,id=c8afcc68-8e70-4968-a9bf-23cecac77f87,network=Network(86494682-2e87-472a-94a2-30c82c1a772f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8afcc68-8e')
Aug 14 15:21:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Deleting instance files /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa_del
Aug 14 15:21:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Deletion of /opt/stack/data/nova/instances/052ee1d6-85bb-4d57-b014-ed5d3edab2aa_del complete
Aug 14 15:21:03 user nova-compute[73254]: INFO nova.compute.manager [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 14 15:21:03 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:21:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:21:04 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Took 0.83 seconds to deallocate network for instance.
Aug 14 15:21:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-abb0fb6b-9740-4675-a98d-0212202464b3 req-558dee93-0319-4e09-9044-6c35f98e43e0 service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Received event network-vif-deleted-c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:04 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Deleted allocations for instance 052ee1d6-85bb-4d57-b014-ed5d3edab2aa
Aug 14 15:21:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-068f6e38-97e1-4740-84b5-ec36f2231840 tempest-VolumesNegativeTest-2048836891 tempest-VolumesNegativeTest-2048836891-project-member] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-bd99b466-d3d7-48e8-a88a-9fcfed95a111 req-c0e5ce70-13ce-424e-823e-0ed2805c5d9f service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Received event network-vif-plugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bd99b466-d3d7-48e8-a88a-9fcfed95a111 req-c0e5ce70-13ce-424e-823e-0ed2805c5d9f service nova] Acquiring lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bd99b466-d3d7-48e8-a88a-9fcfed95a111 req-c0e5ce70-13ce-424e-823e-0ed2805c5d9f service nova] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bd99b466-d3d7-48e8-a88a-9fcfed95a111 req-c0e5ce70-13ce-424e-823e-0ed2805c5d9f service nova] Lock "052ee1d6-85bb-4d57-b014-ed5d3edab2aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:04 user nova-compute[73254]: DEBUG nova.compute.manager [req-bd99b466-d3d7-48e8-a88a-9fcfed95a111 req-c0e5ce70-13ce-424e-823e-0ed2805c5d9f service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] No waiting events found dispatching network-vif-plugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:21:04 user nova-compute[73254]: WARNING nova.compute.manager [req-bd99b466-d3d7-48e8-a88a-9fcfed95a111 req-c0e5ce70-13ce-424e-823e-0ed2805c5d9f service nova] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Received unexpected event network-vif-plugged-c8afcc68-8e70-4968-a9bf-23cecac77f87 for instance with vm_state deleted and task_state None.
Aug 14 15:21:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:21:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:08 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:21:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:21:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:21:10 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:21:10 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8135MB free_disk=25.005558013916016GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0578772b-534f-4d29-9b68-d9b691d339e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 078c2370-66ff-42b3-9e41-b3b7cefed1f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 5a927b8b-123f-40c7-a292-ee61f9afde9d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:21:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:21:13 user nova-compute[73254]: INFO nova.compute.claims [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Claim successful on node user
Aug 14 15:21:13 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:21:13 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:21:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:21:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:21:14 user nova-compute[73254]: INFO nova.virt.block_device [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Booting with volume d45598e1-71cb-4a83-a537-f45ec99c9254 at /dev/vda
Aug 14 15:21:14 user nova-compute[73254]: DEBUG nova.policy [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dff145de66554050ade3990af9aba7fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b77df2a55974cec9ee846a3d2166131', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG os_brick.utils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e592c1-c410-4912-8f82-4a90a7ac5809]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e3280d-5176-420d-a272-b61a997923ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[13251309-f567-4369-b643-24b3b4d62b06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[73beab65-208d-492a-85ce-aa641c25048a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:21:14 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08a3cbb-12ed-41e8-a5c6-c3ceb57f9808]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG os_brick.utils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating existing volume attachment record: aa992df1-4dfe-4a30-b507-291652406602 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:21:14 user nova-compute[73254]: INFO nova.compute.claims [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Claim successful on node user
Aug 14 15:21:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Successfully created port: 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:21:14 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:21:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.policy [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4518a054567744089ed8477a58377821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05958df454f94ce5acc81cf06b929d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:21:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Creating image(s)
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "/opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "/opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "/opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk 1073741824" returned: 0 in 0.054s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Successfully updated port: 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquired lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-c3c11039-14cf-45cb-9a6b-0edbc48d81d1 req-db0c45f3-b7ad-4123-baab-f3175afec1f7 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-changed-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.compute.manager [req-c3c11039-14cf-45cb-9a6b-0edbc48d81d1 req-db0c45f3-b7ad-4123-baab-f3175afec1f7 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Refreshing instance network info cache due to event network-changed-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c3c11039-14cf-45cb-9a6b-0edbc48d81d1 req-db0c45f3-b7ad-4123-baab-f3175afec1f7 service nova] Acquiring lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Successfully created port: 8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Cannot resize image /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:21:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'migration_context' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Ensure instance console log exists: /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating instance_info_cache with network_info: [{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Releasing lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Instance network_info: |[{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c3c11039-14cf-45cb-9a6b-0edbc48d81d1 req-db0c45f3-b7ad-4123-baab-f3175afec1f7 service nova] Acquired lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.neutron [req-c3c11039-14cf-45cb-9a6b-0edbc48d81d1 req-db0c45f3-b7ad-4123-baab-f3175afec1f7 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Refreshing network info cache for port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Successfully updated port: 8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquired lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-bb8abf4d-8c13-47b2-8a2b-0a64a661d6f0 req-fef14490-ae54-4605-a607-2cfb862a7917 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-changed-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-bb8abf4d-8c13-47b2-8a2b-0a64a661d6f0 req-fef14490-ae54-4605-a607-2cfb862a7917 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Refreshing instance network info cache due to event network-changed-8e972792-3462-4547-84e7-bc0b50c37b06. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bb8abf4d-8c13-47b2-8a2b-0a64a661d6f0 req-fef14490-ae54-4605-a607-2cfb862a7917 service nova] Acquiring lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.neutron [req-c3c11039-14cf-45cb-9a6b-0edbc48d81d1 req-db0c45f3-b7ad-4123-baab-f3175afec1f7 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updated VIF entry in instance network info cache for port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.neutron [req-c3c11039-14cf-45cb-9a6b-0edbc48d81d1 req-db0c45f3-b7ad-4123-baab-f3175afec1f7 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating instance_info_cache with network_info: [{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c3c11039-14cf-45cb-9a6b-0edbc48d81d1 req-db0c45f3-b7ad-4123-baab-f3175afec1f7 service nova] Releasing lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updating instance_info_cache with network_info: [{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Releasing lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance network_info: |[{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bb8abf4d-8c13-47b2-8a2b-0a64a661d6f0 req-fef14490-ae54-4605-a607-2cfb862a7917 service nova] Acquired lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.neutron [req-bb8abf4d-8c13-47b2-8a2b-0a64a661d6f0 req-fef14490-ae54-4605-a607-2cfb862a7917 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Refreshing network info cache for port 8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Start _get_guest_xml network_info=[{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:21:16 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:21:16 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-16733886',display_name='tempest-AttachVolumeTestJSON-server-16733886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-16733886',id=41,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxEAZaymEwwljUUm0bIND6+g7UStk6ayOY0oDvHBPzJ7vBCL0k+kKVFgHuWCAyGaHw+gdORl3+kdPOLWn88b3xmGLjBfM0KROLhtVxvGAVzsR9I/6NAtKreWeWvrEUlw==',key_name='tempest-keypair-1829711365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-kumsk06a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=e94cdb72-c3cd-4d1f-a50f-934c2d9218f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'pci_devices' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:21:16 user nova-compute[73254]:   <uuid>e94cdb72-c3cd-4d1f-a50f-934c2d9218f1</uuid>
Aug 14 15:21:16 user nova-compute[73254]:   <name>instance-00000029</name>
Aug 14 15:21:16 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:21:16 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:21:16 user nova-compute[73254]:   <metadata>
Aug 14 15:21:16 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:21:16 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:21:16 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeTestJSON-server-16733886</nova:name>
Aug 14 15:21:16 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:21:16</nova:creationTime>
Aug 14 15:21:16 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:21:16 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:21:16 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:21:16 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:21:16 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:21:16 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:21:16 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:21:16 user nova-compute[73254]:       <nova:owner>
Aug 14 15:21:16 user nova-compute[73254]:         <nova:user uuid="4518a054567744089ed8477a58377821">tempest-AttachVolumeTestJSON-395337043-project-member</nova:user>
Aug 14 15:21:16 user nova-compute[73254]:         <nova:project uuid="05958df454f94ce5acc81cf06b929d27">tempest-AttachVolumeTestJSON-395337043</nova:project>
Aug 14 15:21:16 user nova-compute[73254]:       </nova:owner>
Aug 14 15:21:16 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:21:16 user nova-compute[73254]:       <nova:ports>
Aug 14 15:21:16 user nova-compute[73254]:         <nova:port uuid="8e972792-3462-4547-84e7-bc0b50c37b06">
Aug 14 15:21:16 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 15:21:16 user nova-compute[73254]:         </nova:port>
Aug 14 15:21:16 user nova-compute[73254]:       </nova:ports>
Aug 14 15:21:16 user nova-compute[73254]:     </nova:instance>
Aug 14 15:21:16 user nova-compute[73254]:   </metadata>
Aug 14 15:21:16 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:21:16 user nova-compute[73254]:     <system>
Aug 14 15:21:16 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:21:16 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:21:16 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:21:16 user nova-compute[73254]:       <entry name="serial">e94cdb72-c3cd-4d1f-a50f-934c2d9218f1</entry>
Aug 14 15:21:16 user nova-compute[73254]:       <entry name="uuid">e94cdb72-c3cd-4d1f-a50f-934c2d9218f1</entry>
Aug 14 15:21:16 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:21:16 user nova-compute[73254]:     </system>
Aug 14 15:21:16 user nova-compute[73254]:   </sysinfo>
Aug 14 15:21:16 user nova-compute[73254]:   <os>
Aug 14 15:21:16 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:21:16 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:21:16 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:21:16 user nova-compute[73254]:   </os>
Aug 14 15:21:16 user nova-compute[73254]:   <features>
Aug 14 15:21:16 user nova-compute[73254]:     <acpi/>
Aug 14 15:21:16 user nova-compute[73254]:     <apic/>
Aug 14 15:21:16 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:21:16 user nova-compute[73254]:   </features>
Aug 14 15:21:16 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:21:16 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:21:16 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:21:16 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:21:16 user nova-compute[73254]:   </clock>
Aug 14 15:21:16 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:21:16 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:21:16 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:21:16 user nova-compute[73254]:   </cpu>
Aug 14 15:21:16 user nova-compute[73254]:   <devices>
Aug 14 15:21:16 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:21:16 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:21:16 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk"/>
Aug 14 15:21:16 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:21:16 user nova-compute[73254]:     </disk>
Aug 14 15:21:16 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:21:16 user nova-compute[73254]:       <mac address="fa:16:3e:5b:40:78"/>
Aug 14 15:21:16 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:21:16 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:21:16 user nova-compute[73254]:       <target dev="tap8e972792-34"/>
Aug 14 15:21:16 user nova-compute[73254]:     </interface>
Aug 14 15:21:16 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:21:16 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/console.log" append="off"/>
Aug 14 15:21:16 user nova-compute[73254]:     </serial>
Aug 14 15:21:16 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:21:16 user nova-compute[73254]:     <video>
Aug 14 15:21:16 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:21:16 user nova-compute[73254]:     </video>
Aug 14 15:21:16 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:21:16 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:21:16 user nova-compute[73254]:     </rng>
Aug 14 15:21:16 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:21:16 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:21:16 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:21:16 user nova-compute[73254]:     </memballoon>
Aug 14 15:21:16 user nova-compute[73254]:   </devices>
Aug 14 15:21:16 user nova-compute[73254]: </domain>
Aug 14 15:21:16 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-16733886',display_name='tempest-AttachVolumeTestJSON-server-16733886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-16733886',id=41,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxEAZaymEwwljUUm0bIND6+g7UStk6ayOY0oDvHBPzJ7vBCL0k+kKVFgHuWCAyGaHw+gdORl3+kdPOLWn88b3xmGLjBfM0KROLhtVxvGAVzsR9I/6NAtKreWeWvrEUlw==',key_name='tempest-keypair-1829711365',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-kumsk06a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:21:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=e94cdb72-c3cd-4d1f-a50f-934c2d9218f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG os_vif [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e972792-34, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e972792-34, col_values=(('external_ids', {'iface-id': '8e972792-3462-4547-84e7-bc0b50c37b06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:40:78', 'vm-uuid': 'e94cdb72-c3cd-4d1f-a50f-934c2d9218f1'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:16 user nova-compute[73254]: INFO os_vif [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34')
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:21:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No VIF found with MAC fa:16:3e:5b:40:78, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:21:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-bb8abf4d-8c13-47b2-8a2b-0a64a661d6f0 req-fef14490-ae54-4605-a607-2cfb862a7917 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updated VIF entry in instance network info cache for port 8e972792-3462-4547-84e7-bc0b50c37b06. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:21:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-bb8abf4d-8c13-47b2-8a2b-0a64a661d6f0 req-fef14490-ae54-4605-a607-2cfb862a7917 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updating instance_info_cache with network_info: [{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:21:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-bb8abf4d-8c13-47b2-8a2b-0a64a661d6f0 req-fef14490-ae54-4605-a607-2cfb862a7917 service nova] Releasing lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:21:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:21:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:21:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:21:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:21:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026463.1100512, 052ee1d6-85bb-4d57-b014-ed5d3edab2aa => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:21:18 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] VM Stopped (Lifecycle Event)
Aug 14 15:21:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-46149d32-daca-4d1a-a55e-673412c09eb8 None None] [instance: 052ee1d6-85bb-4d57-b014-ed5d3edab2aa] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-abff70f4-fa15-452c-8bdb-4a2debed13b2 req-29ae61af-454e-4a48-b120-0c642d616b21 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-abff70f4-fa15-452c-8bdb-4a2debed13b2 req-29ae61af-454e-4a48-b120-0c642d616b21 service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-abff70f4-fa15-452c-8bdb-4a2debed13b2 req-29ae61af-454e-4a48-b120-0c642d616b21 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-abff70f4-fa15-452c-8bdb-4a2debed13b2 req-29ae61af-454e-4a48-b120-0c642d616b21 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-abff70f4-fa15-452c-8bdb-4a2debed13b2 req-29ae61af-454e-4a48-b120-0c642d616b21 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:21:18 user nova-compute[73254]: WARNING nova.compute.manager [req-abff70f4-fa15-452c-8bdb-4a2debed13b2 req-29ae61af-454e-4a48-b120-0c642d616b21 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state building and task_state spawning.
Aug 14 15:21:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:19 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updating instance_info_cache with network_info: [{"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:21:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:21:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026480.371426, e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:21:20 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] VM Resumed (Lifecycle Event)
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:21:20 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance spawned successfully.
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:20 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026480.3748462, e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:21:20 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] VM Started (Lifecycle Event)
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-abcf583b-cf02-451d-9320-15428c0fc3ca req-55bb2245-6678-4cfa-9f84-ab223fb3f0cf service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-abcf583b-cf02-451d-9320-15428c0fc3ca req-55bb2245-6678-4cfa-9f84-ab223fb3f0cf service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-abcf583b-cf02-451d-9320-15428c0fc3ca req-55bb2245-6678-4cfa-9f84-ab223fb3f0cf service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-abcf583b-cf02-451d-9320-15428c0fc3ca req-55bb2245-6678-4cfa-9f84-ab223fb3f0cf service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-abcf583b-cf02-451d-9320-15428c0fc3ca req-55bb2245-6678-4cfa-9f84-ab223fb3f0cf service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:21:20 user nova-compute[73254]: WARNING nova.compute.manager [req-abcf583b-cf02-451d-9320-15428c0fc3ca req-55bb2245-6678-4cfa-9f84-ab223fb3f0cf service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state building and task_state spawning.
Aug 14 15:21:20 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:21:20 user nova-compute[73254]: INFO nova.compute.manager [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 14 15:21:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:21:20 user nova-compute[73254]: INFO nova.compute.manager [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Took 6.08 seconds to build instance.
Aug 14 15:21:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d44bd58f-90e1-4b8b-988f-c18edf93a6ab tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.184s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:21:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:21:23 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Creating image(s)
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Ensure instance console log exists: /opt/stack/data/nova/instances/37e5fe23-df6c-48ba-80af-0c2f866a6447/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Start _get_guest_xml network_info=[{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'aa992df1-4dfe-4a30-b507-291652406602', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTQcKEnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37e5fe23-df6c-48ba-80af-0c2f866a6447', 'attached_at': '', 'detached_at': '', 'volume_id': 'd45598e1-71cb-4a83-a537-f45ec99c9254', 'serial': 'd45598e1-71cb-4a83-a537-f45ec99c9254'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:21:23 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:21:23 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTQcKEnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:21:23 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:21:23 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:21:23 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ffe447-6130-451e-92ce-f4d15c7552a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:21:23 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb9fa4b-6611-45d7-8f79-e3808602515d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254] added
Aug 14 15:21:23 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a9c922-6e79-4263-9be1-d10d7a9ae13a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8aaeb1e-7816-4822-9b36-e852a7fa28d0]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTQcKEnX {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTQcKEnX" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25286f4-47c9-4039-bbbd-4855531e9c28]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xTQcKEnX'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd53c9b-ad4d-44d5-b53a-7cd1179bc98a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8492ba78-6560-4aca-a728-0ccb6c864b04]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:21:23 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:21:23 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:21:23 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:21:23 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:21:23 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:21:23 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[505ee623-62e5-4acf-b87f-96de1c459c42]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260]
Aug 14 15:21:23 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260] successful.
Aug 14 15:21:23 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3e3ab7-d57d-4add-b314-468ef1348fb5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3704f60f-886d-4702-9892-1bb35ab14392]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:21:23 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:21:23 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:21:23 user nova-compute[73254]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:21:23 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:21:23 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:21:23 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:21:23 user nova-compute[73254]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:21:23 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f6320e-8642-4de5-a73d-5264a82a3127]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:21:23 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTQcKEnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23566313736396466', 'path': '/dev/sde'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566313736396466', 'path': '/dev/sde'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-725449484',display_name='tempest-TestShelveInstance-server-725449484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-725449484',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvXaNMrXK2DDVgAmpRMdqbeyBWUzcoLtZIgZ4qbnePHIM9kJToBP8I+gY4EOJUzyVwXfxUWEy+sUtE0DBYkzEuhvOg0+x/1O7VDtwpMsEmNn8x3yMx4L6e85Fdhklfg6Q==',key_name='tempest-TestShelveInstance-1809884015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b77df2a55974cec9ee846a3d2166131',ramdisk_id='',reservation_id='r-ehw0yruh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-500249239',owner_user_name='tempest-TestShelveInstance-500249239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:21:14Z,user_data=None,user_id='dff145de66554050ade3990af9aba7fa',uuid=37e5fe23-df6c-48ba-80af-0c2f866a6447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converting VIF {"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lazy-loading 'pci_devices' on Instance uuid 37e5fe23-df6c-48ba-80af-0c2f866a6447 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:21:24 user nova-compute[73254]:   <uuid>37e5fe23-df6c-48ba-80af-0c2f866a6447</uuid>
Aug 14 15:21:24 user nova-compute[73254]:   <name>instance-00000028</name>
Aug 14 15:21:24 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:21:24 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:21:24 user nova-compute[73254]:   <metadata>
Aug 14 15:21:24 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:21:24 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:21:24 user nova-compute[73254]:       <nova:name>tempest-TestShelveInstance-server-725449484</nova:name>
Aug 14 15:21:24 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:21:23</nova:creationTime>
Aug 14 15:21:24 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:21:24 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:21:24 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:21:24 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:21:24 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:21:24 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:21:24 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:21:24 user nova-compute[73254]:       <nova:owner>
Aug 14 15:21:24 user nova-compute[73254]:         <nova:user uuid="dff145de66554050ade3990af9aba7fa">tempest-TestShelveInstance-500249239-project-member</nova:user>
Aug 14 15:21:24 user nova-compute[73254]:         <nova:project uuid="4b77df2a55974cec9ee846a3d2166131">tempest-TestShelveInstance-500249239</nova:project>
Aug 14 15:21:24 user nova-compute[73254]:       </nova:owner>
Aug 14 15:21:24 user nova-compute[73254]:       <nova:ports>
Aug 14 15:21:24 user nova-compute[73254]:         <nova:port uuid="67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f">
Aug 14 15:21:24 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 15:21:24 user nova-compute[73254]:         </nova:port>
Aug 14 15:21:24 user nova-compute[73254]:       </nova:ports>
Aug 14 15:21:24 user nova-compute[73254]:     </nova:instance>
Aug 14 15:21:24 user nova-compute[73254]:   </metadata>
Aug 14 15:21:24 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:21:24 user nova-compute[73254]:     <system>
Aug 14 15:21:24 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:21:24 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:21:24 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:21:24 user nova-compute[73254]:       <entry name="serial">37e5fe23-df6c-48ba-80af-0c2f866a6447</entry>
Aug 14 15:21:24 user nova-compute[73254]:       <entry name="uuid">37e5fe23-df6c-48ba-80af-0c2f866a6447</entry>
Aug 14 15:21:24 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:21:24 user nova-compute[73254]:     </system>
Aug 14 15:21:24 user nova-compute[73254]:   </sysinfo>
Aug 14 15:21:24 user nova-compute[73254]:   <os>
Aug 14 15:21:24 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:21:24 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:21:24 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:21:24 user nova-compute[73254]:   </os>
Aug 14 15:21:24 user nova-compute[73254]:   <features>
Aug 14 15:21:24 user nova-compute[73254]:     <acpi/>
Aug 14 15:21:24 user nova-compute[73254]:     <apic/>
Aug 14 15:21:24 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:21:24 user nova-compute[73254]:   </features>
Aug 14 15:21:24 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:21:24 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:21:24 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:21:24 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:21:24 user nova-compute[73254]:   </clock>
Aug 14 15:21:24 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:21:24 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:21:24 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:21:24 user nova-compute[73254]:   </cpu>
Aug 14 15:21:24 user nova-compute[73254]:   <devices>
Aug 14 15:21:24 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:21:24 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:21:24 user nova-compute[73254]:       <source dev="/dev/sde"/>
Aug 14 15:21:24 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:21:24 user nova-compute[73254]:       <serial>d45598e1-71cb-4a83-a537-f45ec99c9254</serial>
Aug 14 15:21:24 user nova-compute[73254]:     </disk>
Aug 14 15:21:24 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:21:24 user nova-compute[73254]:       <mac address="fa:16:3e:a6:3e:fb"/>
Aug 14 15:21:24 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:21:24 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:21:24 user nova-compute[73254]:       <target dev="tap67f9ad46-1b"/>
Aug 14 15:21:24 user nova-compute[73254]:     </interface>
Aug 14 15:21:24 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:21:24 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/37e5fe23-df6c-48ba-80af-0c2f866a6447/console.log" append="off"/>
Aug 14 15:21:24 user nova-compute[73254]:     </serial>
Aug 14 15:21:24 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:21:24 user nova-compute[73254]:     <video>
Aug 14 15:21:24 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:21:24 user nova-compute[73254]:     </video>
Aug 14 15:21:24 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:21:24 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:21:24 user nova-compute[73254]:     </rng>
Aug 14 15:21:24 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:21:24 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:21:24 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:21:24 user nova-compute[73254]:     </memballoon>
Aug 14 15:21:24 user nova-compute[73254]:   </devices>
Aug 14 15:21:24 user nova-compute[73254]: </domain>
Aug 14 15:21:24 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-725449484',display_name='tempest-TestShelveInstance-server-725449484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-725449484',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvXaNMrXK2DDVgAmpRMdqbeyBWUzcoLtZIgZ4qbnePHIM9kJToBP8I+gY4EOJUzyVwXfxUWEy+sUtE0DBYkzEuhvOg0+x/1O7VDtwpMsEmNn8x3yMx4L6e85Fdhklfg6Q==',key_name='tempest-TestShelveInstance-1809884015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b77df2a55974cec9ee846a3d2166131',ramdisk_id='',reservation_id='r-ehw0yruh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-500249239',owner_user_name='tempest-TestShelveInstance-500249239-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:21:14Z,user_data=None,user_id='dff145de66554050ade3990af9aba7fa',uuid=37e5fe23-df6c-48ba-80af-0c2f866a6447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converting VIF {"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG os_vif [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67f9ad46-1b, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67f9ad46-1b, col_values=(('external_ids', {'iface-id': '67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:3e:fb', 'vm-uuid': '37e5fe23-df6c-48ba-80af-0c2f866a6447'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:24 user nova-compute[73254]: INFO os_vif [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b')
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:21:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] No VIF found with MAC fa:16:3e:a6:3e:fb, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-cb573d4b-e428-4f25-926e-385262eb2795 req-9824a58c-9721-45ca-b75a-be411f7df2d1 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cb573d4b-e428-4f25-926e-385262eb2795 req-9824a58c-9721-45ca-b75a-be411f7df2d1 service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cb573d4b-e428-4f25-926e-385262eb2795 req-9824a58c-9721-45ca-b75a-be411f7df2d1 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cb573d4b-e428-4f25-926e-385262eb2795 req-9824a58c-9721-45ca-b75a-be411f7df2d1 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG nova.compute.manager [req-cb573d4b-e428-4f25-926e-385262eb2795 req-9824a58c-9721-45ca-b75a-be411f7df2d1 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:21:26 user nova-compute[73254]: WARNING nova.compute.manager [req-cb573d4b-e428-4f25-926e-385262eb2795 req-9824a58c-9721-45ca-b75a-be411f7df2d1 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received unexpected event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with vm_state building and task_state spawning.
Aug 14 15:21:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026488.1578588, 37e5fe23-df6c-48ba-80af-0c2f866a6447 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:21:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] VM Resumed (Lifecycle Event)
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:21:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Instance spawned successfully.
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:21:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026488.1587834, 37e5fe23-df6c-48ba-80af-0c2f866a6447 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:21:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] VM Started (Lifecycle Event)
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:21:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:21:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-0c2eac52-cf08-48aa-be64-c089bc53abe5 req-0ae769da-df48-4261-b63f-f03a3fdbfc7a service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0c2eac52-cf08-48aa-be64-c089bc53abe5 req-0ae769da-df48-4261-b63f-f03a3fdbfc7a service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0c2eac52-cf08-48aa-be64-c089bc53abe5 req-0ae769da-df48-4261-b63f-f03a3fdbfc7a service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0c2eac52-cf08-48aa-be64-c089bc53abe5 req-0ae769da-df48-4261-b63f-f03a3fdbfc7a service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-0c2eac52-cf08-48aa-be64-c089bc53abe5 req-0ae769da-df48-4261-b63f-f03a3fdbfc7a service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:21:28 user nova-compute[73254]: WARNING nova.compute.manager [req-0c2eac52-cf08-48aa-be64-c089bc53abe5 req-0ae769da-df48-4261-b63f-f03a3fdbfc7a service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received unexpected event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with vm_state building and task_state spawning.
Aug 14 15:21:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Took 14.85 seconds to build instance.
Aug 14 15:21:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c837f7ac-551a-42cb-8016-64eb37b5d8a8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.955s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:42 user nova-compute[73254]: INFO nova.compute.manager [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Terminating instance
Aug 14 15:21:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-72c812f2-b0f5-45c5-a162-6a2b4aed6d38 req-93845767-3fc7-4ed6-939f-4a38b7df1277 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-unplugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72c812f2-b0f5-45c5-a162-6a2b4aed6d38 req-93845767-3fc7-4ed6-939f-4a38b7df1277 service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72c812f2-b0f5-45c5-a162-6a2b4aed6d38 req-93845767-3fc7-4ed6-939f-4a38b7df1277 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72c812f2-b0f5-45c5-a162-6a2b4aed6d38 req-93845767-3fc7-4ed6-939f-4a38b7df1277 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-72c812f2-b0f5-45c5-a162-6a2b4aed6d38 req-93845767-3fc7-4ed6-939f-4a38b7df1277 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-unplugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-72c812f2-b0f5-45c5-a162-6a2b4aed6d38 req-93845767-3fc7-4ed6-939f-4a38b7df1277 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-unplugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Instance destroyed successfully.
Aug 14 15:21:43 user nova-compute[73254]: DEBUG nova.objects.instance [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'resources' on Instance uuid 078c2370-66ff-42b3-9e41-b3b7cefed1f2 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:16:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2089501983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2089501983',id=37,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:18:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-zg8zegya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:19:56Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=078c2370-66ff-42b3-9e41-b3b7cefed1f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "address": "fa:16:3e:a1:3e:1d", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d7a02f9-7e", "ovs_interfaceid": "0d7a02f9-7e5d-44fa-958c-118d1d41df54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3e:1d,bridge_name='br-int',has_traffic_filtering=True,id=0d7a02f9-7e5d-44fa-958c-118d1d41df54,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7a02f9-7e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_vif [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3e:1d,bridge_name='br-int',has_traffic_filtering=True,id=0d7a02f9-7e5d-44fa-958c-118d1d41df54,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7a02f9-7e') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d7a02f9-7e, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:43 user nova-compute[73254]: INFO os_vif [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:3e:1d,bridge_name='br-int',has_traffic_filtering=True,id=0d7a02f9-7e5d-44fa-958c-118d1d41df54,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d7a02f9-7e')
Aug 14 15:21:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'daOqtYTP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:21:43 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb59fab7-25a3-4ffc-b877-4873d3861ace]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c6e020-e3a7-4e41-bcda-6186555e4b82]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:21:43 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:21:43 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:21:43 user nova-compute[73254]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:21:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:21:43 user nova-compute[73254]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 (non-flash)
Aug 14 15:21:43 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:21:43 user nova-compute[73254]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:21:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648572680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188'): ({'sdd'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Removing single pathed devices sdd {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3f2b2b-8f06-4feb-b893-8f9a289d8fdd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4563b7ee-14fa-460f-85ab-e09f6a6281df]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flushing IO for device /dev/sdd {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ed20d4-78f1-4416-a7a5-d60d27125d23]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8ed9ba-6e1b-4a5f-b5d0-45ea6b42c537]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO94ba44c8-e6974cbb67a46644', '/dev/disk/by-id/scsi-26536393734636262', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_94ba44c8') {{(pid=84090) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a7396d-227c-4df7-9b25-80731d442135]: (4, None) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54cef4a-fd10-4ba9-b0f0-9caef3a1f2c4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c7b688-0f1c-4973-8b5d-839447df0503]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188, portal: 172.16.0.220,3260]
Aug 14 15:21:43 user nova-compute[73254]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188, portal: 172.16.0.220,3260] successful.
Aug 14 15:21:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:481c1650-bf1f-4268-8d68-f7afe8c9e188 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cb2ec8-4dc8-48f9-8da7-26a09846a583]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] <== disconnect_volume: return (290ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:21:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Deleting instance files /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2_del
Aug 14 15:21:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Deletion of /opt/stack/data/nova/instances/078c2370-66ff-42b3-9e41-b3b7cefed1f2_del complete
Aug 14 15:21:43 user nova-compute[73254]: INFO nova.compute.manager [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 14 15:21:43 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:21:43 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:21:44 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:21:44 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Took 0.81 seconds to deallocate network for instance.
Aug 14 15:21:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-aa12849f-9525-41e8-bc29-00b38f30f7c5 req-620de432-97bf-44a2-90b5-8857722a8914 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-deleted-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:44 user nova-compute[73254]: INFO nova.compute.manager [req-aa12849f-9525-41e8-bc29-00b38f30f7c5 req-620de432-97bf-44a2-90b5-8857722a8914 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Neutron deleted interface 0d7a02f9-7e5d-44fa-958c-118d1d41df54; detaching it from the instance and deleting it from the info cache
Aug 14 15:21:44 user nova-compute[73254]: DEBUG nova.network.neutron [req-aa12849f-9525-41e8-bc29-00b38f30f7c5 req-620de432-97bf-44a2-90b5-8857722a8914 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:21:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-aa12849f-9525-41e8-bc29-00b38f30f7c5 req-620de432-97bf-44a2-90b5-8857722a8914 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Detach interface failed, port_id=0d7a02f9-7e5d-44fa-958c-118d1d41df54, reason: Instance 078c2370-66ff-42b3-9e41-b3b7cefed1f2 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:21:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-cb61faec-67a0-49c6-8b82-c279e529e13a req-b53101be-2f9a-4efb-90e0-2b61ab7c4434 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:21:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cb61faec-67a0-49c6-8b82-c279e529e13a req-b53101be-2f9a-4efb-90e0-2b61ab7c4434 service nova] Acquiring lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cb61faec-67a0-49c6-8b82-c279e529e13a req-b53101be-2f9a-4efb-90e0-2b61ab7c4434 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cb61faec-67a0-49c6-8b82-c279e529e13a req-b53101be-2f9a-4efb-90e0-2b61ab7c4434 service nova] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-cb61faec-67a0-49c6-8b82-c279e529e13a req-b53101be-2f9a-4efb-90e0-2b61ab7c4434 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] No waiting events found dispatching network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:21:44 user nova-compute[73254]: WARNING nova.compute.manager [req-cb61faec-67a0-49c6-8b82-c279e529e13a req-b53101be-2f9a-4efb-90e0-2b61ab7c4434 service nova] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Received unexpected event network-vif-plugged-0d7a02f9-7e5d-44fa-958c-118d1d41df54 for instance with vm_state active and task_state deleting.
Aug 14 15:21:44 user nova-compute[73254]: INFO nova.compute.manager [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Took 0.72 seconds to detach 1 volumes for instance.
Aug 14 15:21:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:21:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:21:45 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:21:45 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:21:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:45 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Deleted allocations for instance 078c2370-66ff-42b3-9e41-b3b7cefed1f2
Aug 14 15:21:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2ab16bd7-4f86-45b0-a774-9597b633d218 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "078c2370-66ff-42b3-9e41-b3b7cefed1f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.130s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:21:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:21:58 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026503.060715, 078c2370-66ff-42b3-9e41-b3b7cefed1f2 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:21:58 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] VM Stopped (Lifecycle Event)
Aug 14 15:21:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fd5f4614-e174-48ee-bc83-e0a635e2b019 None None] [instance: 078c2370-66ff-42b3-9e41-b3b7cefed1f2] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:21:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:22:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:10 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:22:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:22:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:22:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:22:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:22:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:22:12 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=7940MB free_disk=24.965553283691406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:22:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 0578772b-534f-4d29-9b68-d9b691d339e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 5a927b8b-123f-40c7-a292-ee61f9afde9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 37e5fe23-df6c-48ba-80af-0c2f866a6447 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:22:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:22:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:22:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:22:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:22:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:22:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:22:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:22:18 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:22:19 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updating instance_info_cache with network_info: [{"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:22:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:22:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:22:19 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:22:19 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:22:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:22:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:22:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:21 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:22:21 user nova-compute[73254]: INFO nova.compute.claims [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Claim successful on node user
Aug 14 15:22:22 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG nova.network.neutron [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:22:22 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:22:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG nova.policy [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b639f723cee84d449ba64978be430ff0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c792b3951946b6b51a89e39a871e3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:22:22 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Creating image(s)
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "/opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "/opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "/opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.172s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk 1073741824" returned: 0 in 0.051s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:22 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG nova.network.neutron [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Successfully created port: 26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Cannot resize image /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG nova.objects.instance [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'migration_context' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Ensure instance console log exists: /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG nova.network.neutron [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Successfully updated port: 26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquired lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:22:23 user nova-compute[73254]: DEBUG nova.network.neutron [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.network.neutron [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-fca03b0c-a4db-492b-9e0e-6a9ae0a1ef75 req-45fa0ac6-8ddf-4509-993e-9ee3333a2748 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received event network-changed-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.compute.manager [req-fca03b0c-a4db-492b-9e0e-6a9ae0a1ef75 req-45fa0ac6-8ddf-4509-993e-9ee3333a2748 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Refreshing instance network info cache due to event network-changed-26624a33-e8c3-413f-944e-29a2b11e8d1b. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fca03b0c-a4db-492b-9e0e-6a9ae0a1ef75 req-45fa0ac6-8ddf-4509-993e-9ee3333a2748 service nova] Acquiring lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.network.neutron [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updating instance_info_cache with network_info: [{"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Releasing lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Instance network_info: |[{"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fca03b0c-a4db-492b-9e0e-6a9ae0a1ef75 req-45fa0ac6-8ddf-4509-993e-9ee3333a2748 service nova] Acquired lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.network.neutron [req-fca03b0c-a4db-492b-9e0e-6a9ae0a1ef75 req-45fa0ac6-8ddf-4509-993e-9ee3333a2748 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Refreshing network info cache for port 26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Start _get_guest_xml network_info=[{"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:22:24 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:22:24 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-602660682',display_name='tempest-SnapshotDataIntegrityTests-server-602660682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-602660682',id=42,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtkZqy4VPGT7GQhtCJNXPuCo3E14ZVVXQrjznYR7P9Yu7+oXIkJCZdo5XDa/eLxGAoKL5fxn1ZcGXz1copzLQDF/K8UHF35ViaJhBuuQQYITtYh5IomAsLFMNmyRaEvqw==',key_name='tempest-keypair-782124385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59c792b3951946b6b51a89e39a871e3e',ramdisk_id='',reservation_id='r-zsg34299',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-159888697',owner_user_name='tempest-SnapshotDataIntegrityTests-159888697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b639f723cee84d449ba64978be430ff0',uuid=97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Converting VIF {"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:fd:db,bridge_name='br-int',has_traffic_filtering=True,id=26624a33-e8c3-413f-944e-29a2b11e8d1b,network=Network(72c76653-cd29-4269-94c3-b374c77016e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26624a33-e8') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.objects.instance [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'pci_devices' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:22:24 user nova-compute[73254]:   <uuid>97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5</uuid>
Aug 14 15:22:24 user nova-compute[73254]:   <name>instance-0000002a</name>
Aug 14 15:22:24 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:22:24 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:22:24 user nova-compute[73254]:   <metadata>
Aug 14 15:22:24 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:22:24 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:22:24 user nova-compute[73254]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-602660682</nova:name>
Aug 14 15:22:24 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:22:24</nova:creationTime>
Aug 14 15:22:24 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:22:24 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:22:24 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:22:24 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:22:24 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:22:24 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:22:24 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:22:24 user nova-compute[73254]:       <nova:owner>
Aug 14 15:22:24 user nova-compute[73254]:         <nova:user uuid="b639f723cee84d449ba64978be430ff0">tempest-SnapshotDataIntegrityTests-159888697-project-member</nova:user>
Aug 14 15:22:24 user nova-compute[73254]:         <nova:project uuid="59c792b3951946b6b51a89e39a871e3e">tempest-SnapshotDataIntegrityTests-159888697</nova:project>
Aug 14 15:22:24 user nova-compute[73254]:       </nova:owner>
Aug 14 15:22:24 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:22:24 user nova-compute[73254]:       <nova:ports>
Aug 14 15:22:24 user nova-compute[73254]:         <nova:port uuid="26624a33-e8c3-413f-944e-29a2b11e8d1b">
Aug 14 15:22:24 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 15:22:24 user nova-compute[73254]:         </nova:port>
Aug 14 15:22:24 user nova-compute[73254]:       </nova:ports>
Aug 14 15:22:24 user nova-compute[73254]:     </nova:instance>
Aug 14 15:22:24 user nova-compute[73254]:   </metadata>
Aug 14 15:22:24 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:22:24 user nova-compute[73254]:     <system>
Aug 14 15:22:24 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:22:24 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:22:24 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:22:24 user nova-compute[73254]:       <entry name="serial">97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5</entry>
Aug 14 15:22:24 user nova-compute[73254]:       <entry name="uuid">97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5</entry>
Aug 14 15:22:24 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:22:24 user nova-compute[73254]:     </system>
Aug 14 15:22:24 user nova-compute[73254]:   </sysinfo>
Aug 14 15:22:24 user nova-compute[73254]:   <os>
Aug 14 15:22:24 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:22:24 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:22:24 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:22:24 user nova-compute[73254]:   </os>
Aug 14 15:22:24 user nova-compute[73254]:   <features>
Aug 14 15:22:24 user nova-compute[73254]:     <acpi/>
Aug 14 15:22:24 user nova-compute[73254]:     <apic/>
Aug 14 15:22:24 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:22:24 user nova-compute[73254]:   </features>
Aug 14 15:22:24 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:22:24 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:22:24 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:22:24 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:22:24 user nova-compute[73254]:   </clock>
Aug 14 15:22:24 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:22:24 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:22:24 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:22:24 user nova-compute[73254]:   </cpu>
Aug 14 15:22:24 user nova-compute[73254]:   <devices>
Aug 14 15:22:24 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:22:24 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:22:24 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk"/>
Aug 14 15:22:24 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:22:24 user nova-compute[73254]:     </disk>
Aug 14 15:22:24 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:22:24 user nova-compute[73254]:       <mac address="fa:16:3e:04:fd:db"/>
Aug 14 15:22:24 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:22:24 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:22:24 user nova-compute[73254]:       <target dev="tap26624a33-e8"/>
Aug 14 15:22:24 user nova-compute[73254]:     </interface>
Aug 14 15:22:24 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:22:24 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/console.log" append="off"/>
Aug 14 15:22:24 user nova-compute[73254]:     </serial>
Aug 14 15:22:24 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:22:24 user nova-compute[73254]:     <video>
Aug 14 15:22:24 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:22:24 user nova-compute[73254]:     </video>
Aug 14 15:22:24 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:22:24 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:22:24 user nova-compute[73254]:     </rng>
Aug 14 15:22:24 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:22:24 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:22:24 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:22:24 user nova-compute[73254]:     </memballoon>
Aug 14 15:22:24 user nova-compute[73254]:   </devices>
Aug 14 15:22:24 user nova-compute[73254]: </domain>
Aug 14 15:22:24 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-602660682',display_name='tempest-SnapshotDataIntegrityTests-server-602660682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-602660682',id=42,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtkZqy4VPGT7GQhtCJNXPuCo3E14ZVVXQrjznYR7P9Yu7+oXIkJCZdo5XDa/eLxGAoKL5fxn1ZcGXz1copzLQDF/K8UHF35ViaJhBuuQQYITtYh5IomAsLFMNmyRaEvqw==',key_name='tempest-keypair-782124385',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59c792b3951946b6b51a89e39a871e3e',ramdisk_id='',reservation_id='r-zsg34299',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-159888697',owner_user_name='tempest-SnapshotDataIntegrityTests-159888697-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b639f723cee84d449ba64978be430ff0',uuid=97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Converting VIF {"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:fd:db,bridge_name='br-int',has_traffic_filtering=True,id=26624a33-e8c3-413f-944e-29a2b11e8d1b,network=Network(72c76653-cd29-4269-94c3-b374c77016e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26624a33-e8') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG os_vif [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:fd:db,bridge_name='br-int',has_traffic_filtering=True,id=26624a33-e8c3-413f-944e-29a2b11e8d1b,network=Network(72c76653-cd29-4269-94c3-b374c77016e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26624a33-e8') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26624a33-e8, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26624a33-e8, col_values=(('external_ids', {'iface-id': '26624a33-e8c3-413f-944e-29a2b11e8d1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:fd:db', 'vm-uuid': '97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:24 user nova-compute[73254]: INFO os_vif [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:fd:db,bridge_name='br-int',has_traffic_filtering=True,id=26624a33-e8c3-413f-944e-29a2b11e8d1b,network=Network(72c76653-cd29-4269-94c3-b374c77016e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26624a33-e8')
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No VIF found with MAC fa:16:3e:04:fd:db, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.network.neutron [req-fca03b0c-a4db-492b-9e0e-6a9ae0a1ef75 req-45fa0ac6-8ddf-4509-993e-9ee3333a2748 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updated VIF entry in instance network info cache for port 26624a33-e8c3-413f-944e-29a2b11e8d1b. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG nova.network.neutron [req-fca03b0c-a4db-492b-9e0e-6a9ae0a1ef75 req-45fa0ac6-8ddf-4509-993e-9ee3333a2748 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updating instance_info_cache with network_info: [{"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:22:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fca03b0c-a4db-492b-9e0e-6a9ae0a1ef75 req-45fa0ac6-8ddf-4509-993e-9ee3333a2748 service nova] Releasing lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:22:25 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:22:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-dee9eef4-3197-4c12-a5a7-1d39aa6bdfa4 req-3e0f951a-00b3-4b4f-ae37-5c196b6188b2 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received event network-vif-plugged-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:22:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-dee9eef4-3197-4c12-a5a7-1d39aa6bdfa4 req-3e0f951a-00b3-4b4f-ae37-5c196b6188b2 service nova] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-dee9eef4-3197-4c12-a5a7-1d39aa6bdfa4 req-3e0f951a-00b3-4b4f-ae37-5c196b6188b2 service nova] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-dee9eef4-3197-4c12-a5a7-1d39aa6bdfa4 req-3e0f951a-00b3-4b4f-ae37-5c196b6188b2 service nova] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-dee9eef4-3197-4c12-a5a7-1d39aa6bdfa4 req-3e0f951a-00b3-4b4f-ae37-5c196b6188b2 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] No waiting events found dispatching network-vif-plugged-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:22:25 user nova-compute[73254]: WARNING nova.compute.manager [req-dee9eef4-3197-4c12-a5a7-1d39aa6bdfa4 req-3e0f951a-00b3-4b4f-ae37-5c196b6188b2 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received unexpected event network-vif-plugged-26624a33-e8c3-413f-944e-29a2b11e8d1b for instance with vm_state building and task_state spawning.
Aug 14 15:22:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026547.919486, 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:22:27 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] VM Resumed (Lifecycle Event)
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:22:27 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Instance spawned successfully.
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:22:27 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026547.9209702, 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:22:27 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] VM Started (Lifecycle Event)
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:22:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:22:28 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:22:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-774071f6-babd-443e-bc17-d6b7aaa52a70 req-881f188c-f022-462d-9b6b-10f1c7a6b10b service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received event network-vif-plugged-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:22:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-774071f6-babd-443e-bc17-d6b7aaa52a70 req-881f188c-f022-462d-9b6b-10f1c7a6b10b service nova] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-774071f6-babd-443e-bc17-d6b7aaa52a70 req-881f188c-f022-462d-9b6b-10f1c7a6b10b service nova] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-774071f6-babd-443e-bc17-d6b7aaa52a70 req-881f188c-f022-462d-9b6b-10f1c7a6b10b service nova] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-774071f6-babd-443e-bc17-d6b7aaa52a70 req-881f188c-f022-462d-9b6b-10f1c7a6b10b service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] No waiting events found dispatching network-vif-plugged-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:22:28 user nova-compute[73254]: WARNING nova.compute.manager [req-774071f6-babd-443e-bc17-d6b7aaa52a70 req-881f188c-f022-462d-9b6b-10f1c7a6b10b service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received unexpected event network-vif-plugged-26624a33-e8c3-413f-944e-29a2b11e8d1b for instance with vm_state building and task_state spawning.
Aug 14 15:22:28 user nova-compute[73254]: INFO nova.compute.manager [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Took 5.51 seconds to spawn the instance on the hypervisor.
Aug 14 15:22:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:22:28 user nova-compute[73254]: INFO nova.compute.manager [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Took 6.23 seconds to build instance.
Aug 14 15:22:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-67c6e356-f23a-41aa-b4b9-561d68edf68a tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.323s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "0578772b-534f-4d29-9b68-d9b691d339e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:33 user nova-compute[73254]: INFO nova.compute.manager [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Terminating instance
Aug 14 15:22:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: INFO nova.compute.manager [None req-db6bd90c-973c-4e5f-b780-99580e59658a tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Get console output
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-21505a72-6b97-4c2e-87e8-f44fa487a03b req-ebe90cd2-a384-4211-98e9-63e8b45940d6 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received event network-vif-unplugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-21505a72-6b97-4c2e-87e8-f44fa487a03b req-ebe90cd2-a384-4211-98e9-63e8b45940d6 service nova] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-21505a72-6b97-4c2e-87e8-f44fa487a03b req-ebe90cd2-a384-4211-98e9-63e8b45940d6 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-21505a72-6b97-4c2e-87e8-f44fa487a03b req-ebe90cd2-a384-4211-98e9-63e8b45940d6 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-21505a72-6b97-4c2e-87e8-f44fa487a03b req-ebe90cd2-a384-4211-98e9-63e8b45940d6 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] No waiting events found dispatching network-vif-unplugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-21505a72-6b97-4c2e-87e8-f44fa487a03b req-ebe90cd2-a384-4211-98e9-63e8b45940d6 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received event network-vif-unplugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:22:33 user nova-compute[73254]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Instance destroyed successfully.
Aug 14 15:22:33 user nova-compute[73254]: DEBUG nova.objects.instance [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'resources' on Instance uuid 0578772b-534f-4d29-9b68-d9b691d339e0 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:13:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1222166842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1222166842',id=34,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:13:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-1y9om90x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:15:07Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=0578772b-534f-4d29-9b68-d9b691d339e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "address": "fa:16:3e:9c:f8:ab", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7b46e-eb", "ovs_interfaceid": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "address": "fa:16:3e:9c:f8:ab", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdff7b46e-eb", "ovs_interfaceid": "dff7b46e-eb91-40f5-89cc-8dc92aa35544", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=dff7b46e-eb91-40f5-89cc-8dc92aa35544,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7b46e-eb') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG os_vif [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=dff7b46e-eb91-40f5-89cc-8dc92aa35544,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7b46e-eb') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdff7b46e-eb, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:33 user nova-compute[73254]: INFO os_vif [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:f8:ab,bridge_name='br-int',has_traffic_filtering=True,id=dff7b46e-eb91-40f5-89cc-8dc92aa35544,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdff7b46e-eb')
Aug 14 15:22:33 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Deleting instance files /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0_del
Aug 14 15:22:33 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Deletion of /opt/stack/data/nova/instances/0578772b-534f-4d29-9b68-d9b691d339e0_del complete
Aug 14 15:22:33 user nova-compute[73254]: INFO nova.compute.manager [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 14 15:22:33 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:22:33 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:22:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:34 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:22:34 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Took 0.83 seconds to deallocate network for instance.
Aug 14 15:22:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:35 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Deleted allocations for instance 0578772b-534f-4d29-9b68-d9b691d339e0
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fd444b2d-0117-4def-941c-9908b516f4be tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "0578772b-534f-4d29-9b68-d9b691d339e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.193s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] No waiting events found dispatching network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:22:35 user nova-compute[73254]: WARNING nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received unexpected event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 for instance with vm_state deleted and task_state None.
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] No waiting events found dispatching network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:22:35 user nova-compute[73254]: WARNING nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received unexpected event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 for instance with vm_state deleted and task_state None.
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] No waiting events found dispatching network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:22:35 user nova-compute[73254]: WARNING nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received unexpected event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 for instance with vm_state deleted and task_state None.
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Acquiring lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] Lock "0578772b-534f-4d29-9b68-d9b691d339e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] No waiting events found dispatching network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:22:35 user nova-compute[73254]: WARNING nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received unexpected event network-vif-plugged-dff7b46e-eb91-40f5-89cc-8dc92aa35544 for instance with vm_state deleted and task_state None.
Aug 14 15:22:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-3f8c8472-ce2a-4d04-a0c7-df7fa0a0534e req-b5a7f0c4-332d-41c7-a0e4-bd6098b06a73 service nova] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Received event network-vif-deleted-dff7b46e-eb91-40f5-89cc-8dc92aa35544 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:22:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:48 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026553.8617342, 0578772b-534f-4d29-9b68-d9b691d339e0 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:22:48 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] VM Stopped (Lifecycle Event)
Aug 14 15:22:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a5147b30-800d-456e-b0cf-35fa95e01b5c None None] [instance: 0578772b-534f-4d29-9b68-d9b691d339e0] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:22:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:22:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:23:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:05 user nova-compute[73254]: DEBUG nova.compute.manager [req-eed5b18a-6929-405d-a3ef-6fafd3c06d76 req-7db2dd08-805a-4364-a41b-458a4648832e service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-changed-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:05 user nova-compute[73254]: DEBUG nova.compute.manager [req-eed5b18a-6929-405d-a3ef-6fafd3c06d76 req-7db2dd08-805a-4364-a41b-458a4648832e service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Refreshing instance network info cache due to event network-changed-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:23:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-eed5b18a-6929-405d-a3ef-6fafd3c06d76 req-7db2dd08-805a-4364-a41b-458a4648832e service nova] Acquiring lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:23:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-eed5b18a-6929-405d-a3ef-6fafd3c06d76 req-7db2dd08-805a-4364-a41b-458a4648832e service nova] Acquired lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:23:05 user nova-compute[73254]: DEBUG nova.network.neutron [req-eed5b18a-6929-405d-a3ef-6fafd3c06d76 req-7db2dd08-805a-4364-a41b-458a4648832e service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Refreshing network info cache for port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:23:05 user nova-compute[73254]: DEBUG nova.compute.manager [req-1c772614-c48e-4463-b974-a533ebc7927b req-0202ca3e-80a9-4b02-8a59-8dddd92816de service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-changed-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:05 user nova-compute[73254]: DEBUG nova.compute.manager [req-1c772614-c48e-4463-b974-a533ebc7927b req-0202ca3e-80a9-4b02-8a59-8dddd92816de service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Refreshing instance network info cache due to event network-changed-8e972792-3462-4547-84e7-bc0b50c37b06. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:23:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1c772614-c48e-4463-b974-a533ebc7927b req-0202ca3e-80a9-4b02-8a59-8dddd92816de service nova] Acquiring lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:23:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1c772614-c48e-4463-b974-a533ebc7927b req-0202ca3e-80a9-4b02-8a59-8dddd92816de service nova] Acquired lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:23:05 user nova-compute[73254]: DEBUG nova.network.neutron [req-1c772614-c48e-4463-b974-a533ebc7927b req-0202ca3e-80a9-4b02-8a59-8dddd92816de service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Refreshing network info cache for port 8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-eed5b18a-6929-405d-a3ef-6fafd3c06d76 req-7db2dd08-805a-4364-a41b-458a4648832e service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updated VIF entry in instance network info cache for port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-eed5b18a-6929-405d-a3ef-6fafd3c06d76 req-7db2dd08-805a-4364-a41b-458a4648832e service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating instance_info_cache with network_info: [{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-eed5b18a-6929-405d-a3ef-6fafd3c06d76 req-7db2dd08-805a-4364-a41b-458a4648832e service nova] Releasing lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:06 user nova-compute[73254]: INFO nova.compute.manager [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Shelve offloading
Aug 14 15:23:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-1c772614-c48e-4463-b974-a533ebc7927b req-0202ca3e-80a9-4b02-8a59-8dddd92816de service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updated VIF entry in instance network info cache for port 8e972792-3462-4547-84e7-bc0b50c37b06. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG nova.network.neutron [req-1c772614-c48e-4463-b974-a533ebc7927b req-0202ca3e-80a9-4b02-8a59-8dddd92816de service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updating instance_info_cache with network_info: [{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1c772614-c48e-4463-b974-a533ebc7927b req-0202ca3e-80a9-4b02-8a59-8dddd92816de service nova] Releasing lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:06 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Instance destroyed successfully.
Aug 14 15:23:06 user nova-compute[73254]: DEBUG nova.compute.manager [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquired lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:23:06 user nova-compute[73254]: DEBUG nova.network.neutron [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-unplugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-unplugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:07 user nova-compute[73254]: WARNING nova.compute.manager [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received unexpected event network-vif-unplugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with vm_state active and task_state shelving.
Aug 14 15:23:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:07 user nova-compute[73254]: WARNING nova.compute.manager [req-1671d129-c1b8-47d1-a534-fdfa6c2ac74f req-5c64fd46-3739-4eae-8123-0018aa9c991d service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received unexpected event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with vm_state active and task_state shelving.
Aug 14 15:23:07 user nova-compute[73254]: DEBUG nova.network.neutron [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating instance_info_cache with network_info: [{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:23:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Releasing lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:23:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Instance destroyed successfully.
Aug 14 15:23:08 user nova-compute[73254]: DEBUG nova.objects.instance [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lazy-loading 'resources' on Instance uuid 37e5fe23-df6c-48ba-80af-0c2f866a6447 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-725449484',display_name='tempest-TestShelveInstance-server-725449484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-725449484',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvXaNMrXK2DDVgAmpRMdqbeyBWUzcoLtZIgZ4qbnePHIM9kJToBP8I+gY4EOJUzyVwXfxUWEy+sUtE0DBYkzEuhvOg0+x/1O7VDtwpMsEmNn8x3yMx4L6e85Fdhklfg6Q==',key_name='tempest-TestShelveInstance-1809884015',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b77df2a55974cec9ee846a3d2166131',ramdisk_id='',reservation_id='r-ehw0yruh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-500249239',owner_user_name='tempest-TestShelveInstance-500249239-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:21:28Z,user_data=None,user_id='dff145de66554050ade3990af9aba7fa',uuid=37e5fe23-df6c-48ba-80af-0c2f866a6447,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converting VIF {"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_vif [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67f9ad46-1b, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-3dcd0b96-fed8-46a2-8aae-7d3664fd6abd req-da5ce2fe-0d42-416b-9e5b-de444a66ab43 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-changed-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-3dcd0b96-fed8-46a2-8aae-7d3664fd6abd req-da5ce2fe-0d42-416b-9e5b-de444a66ab43 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Refreshing instance network info cache due to event network-changed-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3dcd0b96-fed8-46a2-8aae-7d3664fd6abd req-da5ce2fe-0d42-416b-9e5b-de444a66ab43 service nova] Acquiring lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3dcd0b96-fed8-46a2-8aae-7d3664fd6abd req-da5ce2fe-0d42-416b-9e5b-de444a66ab43 service nova] Acquired lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG nova.network.neutron [req-3dcd0b96-fed8-46a2-8aae-7d3664fd6abd req-da5ce2fe-0d42-416b-9e5b-de444a66ab43 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Refreshing network info cache for port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:23:08 user nova-compute[73254]: INFO os_vif [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b')
Aug 14 15:23:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTQcKEnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:23:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[26650fd5-b153-4000-a782-06a79f7d3aa2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2b9343-933e-4f13-8052-f42cad5ed34c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:23:08 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:23:08 user nova-compute[73254]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:23:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:23:08 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:23:08 user nova-compute[73254]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:23:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64868acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254'): ({'sde'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Removing single pathed devices sde {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa611333-cd93-486e-8fab-3c795aed4c9a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6acdcd2-cf3d-4ba2-b968-1e504dc33555]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Flushing IO for device /dev/sde {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4356243-6e26-42b4-8b33-542522767a58]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71232d1-f488-43d7-9e92-944c385e3bbc]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] SCSI volumes sde have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[325f7d57-b00c-43aa-a39d-155d05ddd59a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a48b26-6273-4d9b-a195-e82d6eaf26b8]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260]
Aug 14 15:23:08 user nova-compute[73254]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260] successful.
Aug 14 15:23:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[299f60fb-9abf-458d-88b5-6702d7fec299]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] <== disconnect_volume: return (268ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:23:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:23:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Deleting instance files /opt/stack/data/nova/instances/37e5fe23-df6c-48ba-80af-0c2f866a6447_del
Aug 14 15:23:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Deletion of /opt/stack/data/nova/instances/37e5fe23-df6c-48ba-80af-0c2f866a6447_del complete
Aug 14 15:23:09 user nova-compute[73254]: DEBUG nova.network.neutron [req-3dcd0b96-fed8-46a2-8aae-7d3664fd6abd req-da5ce2fe-0d42-416b-9e5b-de444a66ab43 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updated VIF entry in instance network info cache for port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:23:09 user nova-compute[73254]: DEBUG nova.network.neutron [req-3dcd0b96-fed8-46a2-8aae-7d3664fd6abd req-da5ce2fe-0d42-416b-9e5b-de444a66ab43 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating instance_info_cache with network_info: [{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": null, "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:23:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3dcd0b96-fed8-46a2-8aae-7d3664fd6abd req-da5ce2fe-0d42-416b-9e5b-de444a66ab43 service nova] Releasing lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:23:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:09 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Deleted allocations for instance 37e5fe23-df6c-48ba-80af-0c2f866a6447
Aug 14 15:23:09 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:23:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:09 user nova-compute[73254]: DEBUG nova.objects.instance [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lazy-loading 'numa_topology' on Instance uuid 37e5fe23-df6c-48ba-80af-0c2f866a6447 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:23:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:09 user nova-compute[73254]: INFO nova.compute.manager [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Attaching volume 2c8ccb90-0f4a-4999-b3be-c82f1addfa26 to /dev/vdb
Aug 14 15:23:10 user nova-compute[73254]: DEBUG os_brick.utils [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[820149a0-0d0c-4322-aa2c-6b57590795d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d316538-0a42-4ebd-8143-44b35386be80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9de772-32df-4bf3-90f7-74b593ed5457]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f86faa1-2b43-438b-a532-5bc3022da394]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:23:10 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8faca6a4-e7f2-4fb8-8b55-db02c24e445a]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG os_brick.utils [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updating existing volume attachment record: 77eb477b-1638-47af-adb6-650523ccf841 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:23:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2b26ed08-8959-4b35-9bf9-540f9ab454f8 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.037s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:11 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:23:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:11 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:23:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:23:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:11 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:23:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:13 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:23:13 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:23:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8068MB free_disk=25.059799194335938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 5a927b8b-123f-40c7-a292-ee61f9afde9d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:23:13 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:23:14 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:23:14 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:23:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGSnHLMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:23:18 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:23:18 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:23:18 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3379ae29-75d2-4906-bdfc-e738120499bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:23:18 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22adfc8-eeb4-4469-9557-fc2e58eaf117]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26] added
Aug 14 15:23:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1e4b83-c7e4-4b18-b790-d250fbdce005]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee78e001-3070-44c0-a953-29e9b9ef31e2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGSnHLMx {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGSnHLMx" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb9847e-4648-435e-8cd7-5abb238b9ac9]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NGSnHLMx'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[396b2c66-19cb-4b82-ad1b-9c78af6442bc]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4c7f0a-8140-4539-a92e-b20089fe0748]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:23:18 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:23:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:23:18 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:23:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b54015-3f65-42a6-aa14-04db5a37931a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260]
Aug 14 15:23:18 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260] successful.
Aug 14 15:23:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0ece2d-1774-4e71-b4df-074c5f7e4f87]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4191970f-13de-4925-bd9f-6d0d284a2557]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:23:18 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:23:18 user nova-compute[73254]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:23:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:23:18 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:23:18 user nova-compute[73254]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:23:18 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa4b7d-e452-456d-adaf-7029347bd315]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:18 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:23:19 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:23:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGSnHLMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:23:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:23:19 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23938353262323863', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:23:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938353262323863', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:23:19 user nova-compute[73254]: DEBUG nova.objects.instance [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:23:19 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:23:19 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:23:19 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:23:19 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:23:19 user nova-compute[73254]:   <serial>2c8ccb90-0f4a-4999-b3be-c82f1addfa26</serial>
Aug 14 15:23:19 user nova-compute[73254]: </disk>
Aug 14 15:23:19 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No VIF found with MAC fa:16:3e:5b:40:78, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-e4f82b63-b6e8-4eed-af05-63b5fcabae30 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.530s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating instance_info_cache with network_info: [{"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-5a927b8b-123f-40c7-a292-ee61f9afde9d" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-21c10d1f-32b9-420c-8501-92d6c3d21adf tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-21c10d1f-32b9-420c-8501-92d6c3d21adf tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-21c10d1f-32b9-420c-8501-92d6c3d21adf tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.compute.manager [None req-21c10d1f-32b9-420c-8501-92d6c3d21adf tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73254) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG nova.objects.instance [None req-21c10d1f-32b9-420c-8501-92d6c3d21adf tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG nova.compute.manager [req-712151c8-e68b-45cd-b559-38dc3081aef4 req-5165dfd5-9eed-41ed-bf74-c2b4708c766d service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-712151c8-e68b-45cd-b559-38dc3081aef4 req-5165dfd5-9eed-41ed-bf74-c2b4708c766d service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-712151c8-e68b-45cd-b559-38dc3081aef4 req-5165dfd5-9eed-41ed-bf74-c2b4708c766d service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-712151c8-e68b-45cd-b559-38dc3081aef4 req-5165dfd5-9eed-41ed-bf74-c2b4708c766d service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG nova.compute.manager [req-712151c8-e68b-45cd-b559-38dc3081aef4 req-5165dfd5-9eed-41ed-bf74-c2b4708c766d service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:21 user nova-compute[73254]: WARNING nova.compute.manager [req-712151c8-e68b-45cd-b559-38dc3081aef4 req-5165dfd5-9eed-41ed-bf74-c2b4708c766d service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state active and task_state powering-off.
Aug 14 15:23:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:21 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance destroyed successfully.
Aug 14 15:23:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-21c10d1f-32b9-420c-8501-92d6c3d21adf tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-21c10d1f-32b9-420c-8501-92d6c3d21adf tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.891s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:21 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026586.9481418, 37e5fe23-df6c-48ba-80af-0c2f866a6447 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:23:21 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] VM Stopped (Lifecycle Event)
Aug 14 15:23:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-8f987d98-3fde-46e8-b8f9-5d58e2fc8304 None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:23:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:23 user nova-compute[73254]: WARNING nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state stopped and task_state None.
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:23 user nova-compute[73254]: WARNING nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state stopped and task_state None.
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:23 user nova-compute[73254]: WARNING nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state stopped and task_state None.
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:23 user nova-compute[73254]: WARNING nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state stopped and task_state None.
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:23 user nova-compute[73254]: WARNING nova.compute.manager [req-96636e6b-e820-4a63-961d-1ae4ccd15c32 req-2d75558b-0366-4f01-b9e5-e25dccf7088e service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state stopped and task_state None.
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:23 user nova-compute[73254]: INFO nova.compute.manager [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Terminating instance
Aug 14 15:23:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:24 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Instance destroyed successfully.
Aug 14 15:23:24 user nova-compute[73254]: DEBUG nova.objects.instance [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'resources' on Instance uuid ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1607424910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1607424910',id=27,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:09:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-e2ytg44n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:11:23Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "46821c5a-d60c-47a2-8b4b-500198ccc670", "address": "fa:16:3e:85:50:48", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46821c5a-d6", "ovs_interfaceid": "46821c5a-d60c-47a2-8b4b-500198ccc670", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:50:48,bridge_name='br-int',has_traffic_filtering=True,id=46821c5a-d60c-47a2-8b4b-500198ccc670,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46821c5a-d6') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_vif [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:50:48,bridge_name='br-int',has_traffic_filtering=True,id=46821c5a-d60c-47a2-8b4b-500198ccc670,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46821c5a-d6') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46821c5a-d6, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:24 user nova-compute[73254]: INFO os_vif [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:50:48,bridge_name='br-int',has_traffic_filtering=True,id=46821c5a-d60c-47a2-8b4b-500198ccc670,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46821c5a-d6')
Aug 14 15:23:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kUauhwsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:23:24 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8dcf1a-b21c-4422-b67e-a524ce53ce8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[beef00e5-c9bb-46ce-ade5-a37ed2dea290]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:23:24 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:23:24 user nova-compute[73254]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:23:24 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 (non-flash)
Aug 14 15:23:24 user nova-compute[73254]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:23:24 user nova-compute[73254]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:23:24 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648552b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[160d9e81-360c-454a-a4ba-5d3fb2f764ca]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[074a6c9f-db48-4735-a1f7-08b0438f4947]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23314f9-fd8a-4e01-8163-36e0c3d19a56]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[718822be-956f-4bf8-8aef-a21c7f82a1f9]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef99e48-e578-4593-845e-4892cf6cf7d1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6493112-a9b1-4e43-8d31-e8aea5565e82]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600, portal: 172.16.0.220,3260]
Aug 14 15:23:24 user nova-compute[73254]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600, portal: 172.16.0.220,3260] successful.
Aug 14 15:23:24 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:850bef41-dcbb-48a6-b505-c81868961600 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf298667-8569-4c75-996b-8621e7600036]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] <== disconnect_volume: return (310ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:23:24 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Deleting instance files /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f_del
Aug 14 15:23:24 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Deletion of /opt/stack/data/nova/instances/ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f_del complete
Aug 14 15:23:24 user nova-compute[73254]: INFO nova.compute.manager [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 14 15:23:24 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:23:24 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-unplugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-unplugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-unplugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] Acquiring lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] No waiting events found dispatching network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:25 user nova-compute[73254]: WARNING nova.compute.manager [req-31002f1d-a7a0-4a8f-8600-aebb1e031f54 req-ad8b661e-57ce-4d23-9ad8-f36a8ec014ec service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received unexpected event network-vif-plugged-46821c5a-d60c-47a2-8b4b-500198ccc670 for instance with vm_state active and task_state deleting.
Aug 14 15:23:25 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:23:25 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Took 0.61 seconds to deallocate network for instance.
Aug 14 15:23:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-4928b5fd-bd40-4f6f-a4c6-c24782f452de req-e2239872-6500-4aaa-a6ff-e964b19cf0f6 service nova] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Received event network-vif-deleted-46821c5a-d60c-47a2-8b4b-500198ccc670 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:25 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:23:26 user nova-compute[73254]: INFO nova.compute.manager [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Took 0.74 seconds to detach 1 volumes for instance.
Aug 14 15:23:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:26 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:23:26 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:23:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:26 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Deleted allocations for instance ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f
Aug 14 15:23:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:23:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-ddcde87d-705c-4167-b0f4-fcb691ef4695 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.928s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:34 user nova-compute[73254]: INFO nova.compute.manager [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Terminating instance
Aug 14 15:23:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-a7ba12a3-05f3-4570-aecc-4806e98870cc req-662e7d67-d84a-47e8-995c-b5b347801021 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-vif-unplugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a7ba12a3-05f3-4570-aecc-4806e98870cc req-662e7d67-d84a-47e8-995c-b5b347801021 service nova] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a7ba12a3-05f3-4570-aecc-4806e98870cc req-662e7d67-d84a-47e8-995c-b5b347801021 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a7ba12a3-05f3-4570-aecc-4806e98870cc req-662e7d67-d84a-47e8-995c-b5b347801021 service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-a7ba12a3-05f3-4570-aecc-4806e98870cc req-662e7d67-d84a-47e8-995c-b5b347801021 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] No waiting events found dispatching network-vif-unplugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-a7ba12a3-05f3-4570-aecc-4806e98870cc req-662e7d67-d84a-47e8-995c-b5b347801021 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-vif-unplugged-8d93b8b1-b5df-46d6-a980-29042ecf502d for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Instance destroyed successfully.
Aug 14 15:23:35 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'resources' on Instance uuid 5a927b8b-123f-40c7-a292-ee61f9afde9d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:16:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1601224980',display_name='tempest-ServerActionsTestOtherA-server-1601224980',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1601224980',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVC3LG9bN01HlSiMNZhDA0zEYEcGLDrYhPpLJz9ta218GScDSC8eEo3thhKHy7nQaAVL89N9YcF8sXNEgn/eaLjWVETDYOO04B8PSlrVv3eBig80mH0AK7hGooJqv3yA==',key_name='tempest-keypair-384224305',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:19:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-1y3gsh57',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:20:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=5a927b8b-123f-40c7-a292-ee61f9afde9d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "address": "fa:16:3e:48:ca:c3", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d93b8b1-b5", "ovs_interfaceid": "8d93b8b1-b5df-46d6-a980-29042ecf502d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_vif [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d93b8b1-b5, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:35 user nova-compute[73254]: INFO os_vif [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:ca:c3,bridge_name='br-int',has_traffic_filtering=True,id=8d93b8b1-b5df-46d6-a980-29042ecf502d,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d93b8b1-b5')
Aug 14 15:23:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GYAabuBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:23:35 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ceeb50-1806-49bc-9e01-ccbfae0d799e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8fe371-f614-47f2-b4b6-236690af1063]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:23:35 user nova-compute[73254]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:23:35 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb (non-flash)
Aug 14 15:23:35 user nova-compute[73254]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:23:35 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648550160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[39766c99-789f-46ae-8023-ce6bdbd76618]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b9fb3e-352b-48c8-8190-a97f2403dc60]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a2e2eb-d821-46af-a054-2b001ad6499d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b9cf0a-7e89-4f3a-ad76-a343a18ea6fb]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c6f2d6-85d2-4bbc-8f9a-508495befe22]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[61577f65-b01e-4d2c-b99b-ac0b55c9dc08]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260]
Aug 14 15:23:35 user nova-compute[73254]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb, portal: 172.16.0.220,3260] successful.
Aug 14 15:23:35 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4ea4429-9e60-4b62-adfd-2377409fddbb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcf077a-e6ea-4b1f-974c-23ba7e956f4e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.258s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] <== disconnect_volume: return (259ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:23:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Deleting instance files /opt/stack/data/nova/instances/5a927b8b-123f-40c7-a292-ee61f9afde9d_del
Aug 14 15:23:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Deletion of /opt/stack/data/nova/instances/5a927b8b-123f-40c7-a292-ee61f9afde9d_del complete
Aug 14 15:23:35 user nova-compute[73254]: INFO nova.compute.manager [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 14 15:23:35 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:23:35 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:23:36 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:23:36 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Took 0.81 seconds to deallocate network for instance.
Aug 14 15:23:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-da95892c-4759-422f-bc35-2927136fe62a req-725324c7-c7b1-4d5b-9f47-55c70bbb2918 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-vif-deleted-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:36 user nova-compute[73254]: INFO nova.compute.manager [req-da95892c-4759-422f-bc35-2927136fe62a req-725324c7-c7b1-4d5b-9f47-55c70bbb2918 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Neutron deleted interface 8d93b8b1-b5df-46d6-a980-29042ecf502d; detaching it from the instance and deleting it from the info cache
Aug 14 15:23:36 user nova-compute[73254]: DEBUG nova.network.neutron [req-da95892c-4759-422f-bc35-2927136fe62a req-725324c7-c7b1-4d5b-9f47-55c70bbb2918 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:23:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-da95892c-4759-422f-bc35-2927136fe62a req-725324c7-c7b1-4d5b-9f47-55c70bbb2918 service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Detach interface failed, port_id=8d93b8b1-b5df-46d6-a980-29042ecf502d, reason: Instance 5a927b8b-123f-40c7-a292-ee61f9afde9d could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:23:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-3bf6bed0-904a-45d3-ae10-9854489e9735 req-6b084584-4af8-4af4-9d50-a4e86e8cd7cb service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:23:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3bf6bed0-904a-45d3-ae10-9854489e9735 req-6b084584-4af8-4af4-9d50-a4e86e8cd7cb service nova] Acquiring lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3bf6bed0-904a-45d3-ae10-9854489e9735 req-6b084584-4af8-4af4-9d50-a4e86e8cd7cb service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3bf6bed0-904a-45d3-ae10-9854489e9735 req-6b084584-4af8-4af4-9d50-a4e86e8cd7cb service nova] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-3bf6bed0-904a-45d3-ae10-9854489e9735 req-6b084584-4af8-4af4-9d50-a4e86e8cd7cb service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] No waiting events found dispatching network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:23:36 user nova-compute[73254]: WARNING nova.compute.manager [req-3bf6bed0-904a-45d3-ae10-9854489e9735 req-6b084584-4af8-4af4-9d50-a4e86e8cd7cb service nova] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Received unexpected event network-vif-plugged-8d93b8b1-b5df-46d6-a980-29042ecf502d for instance with vm_state active and task_state deleting.
Aug 14 15:23:36 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026601.6773553, e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:23:36 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] VM Stopped (Lifecycle Event)
Aug 14 15:23:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-83355c6d-0225-42b3-a44d-af9157e404cd None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:23:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-83355c6d-0225-42b3-a44d-af9157e404cd None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:23:36 user nova-compute[73254]: INFO nova.compute.manager [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Took 0.74 seconds to detach 1 volumes for instance.
Aug 14 15:23:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Deleting volume: d4ea4429-9e60-4b62-adfd-2377409fddbb {{(pid=73254) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 15:23:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:23:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:23:37 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:23:37 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:23:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:37 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Deleted allocations for instance 5a927b8b-123f-40c7-a292-ee61f9afde9d
Aug 14 15:23:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c145aa94-a939-4898-a76d-2cdb864d3bfc tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "5a927b8b-123f-40c7-a292-ee61f9afde9d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.114s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:23:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:39 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026604.4397042, ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:23:39 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] VM Stopped (Lifecycle Event)
Aug 14 15:23:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a8da84af-0ea3-405e-a726-1b189b78c478 None None] [instance: ebc7ea80-eac2-48c7-861c-ea0cc79a8b6f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:23:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:50 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026615.064876, 5a927b8b-123f-40c7-a292-ee61f9afde9d => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:23:50 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] VM Stopped (Lifecycle Event)
Aug 14 15:23:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7a2dab53-1f09-4e62-b276-36be406664c8 None None] [instance: 5a927b8b-123f-40c7-a292-ee61f9afde9d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:23:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:23:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:23:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:23:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:23:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:23:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:24:01 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:01 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:24:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:24:08 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-541b35ab-e579-4ca2-a5bc-1e8a8d1939f1 req-c6acf910-c565-46af-b5da-8f9c3c068cfe service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received event network-changed-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-541b35ab-e579-4ca2-a5bc-1e8a8d1939f1 req-c6acf910-c565-46af-b5da-8f9c3c068cfe service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Refreshing instance network info cache due to event network-changed-26624a33-e8c3-413f-944e-29a2b11e8d1b. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-541b35ab-e579-4ca2-a5bc-1e8a8d1939f1 req-c6acf910-c565-46af-b5da-8f9c3c068cfe service nova] Acquiring lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-541b35ab-e579-4ca2-a5bc-1e8a8d1939f1 req-c6acf910-c565-46af-b5da-8f9c3c068cfe service nova] Acquired lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-541b35ab-e579-4ca2-a5bc-1e8a8d1939f1 req-c6acf910-c565-46af-b5da-8f9c3c068cfe service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Refreshing network info cache for port 26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-541b35ab-e579-4ca2-a5bc-1e8a8d1939f1 req-c6acf910-c565-46af-b5da-8f9c3c068cfe service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updated VIF entry in instance network info cache for port 26624a33-e8c3-413f-944e-29a2b11e8d1b. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG nova.network.neutron [req-541b35ab-e579-4ca2-a5bc-1e8a8d1939f1 req-c6acf910-c565-46af-b5da-8f9c3c068cfe service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updating instance_info_cache with network_info: [{"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-541b35ab-e579-4ca2-a5bc-1e8a8d1939f1 req-c6acf910-c565-46af-b5da-8f9c3c068cfe service nova] Releasing lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:14 user nova-compute[73254]: INFO nova.compute.manager [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Terminating instance
Aug 14 15:24:14 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-1c5dcdb1-10e7-4dbd-8933-e3ef33f55b8a req-4273c8d8-c949-4efa-9ba6-4bd260298b95 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Received event network-vif-unplugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1c5dcdb1-10e7-4dbd-8933-e3ef33f55b8a req-4273c8d8-c949-4efa-9ba6-4bd260298b95 service nova] Acquiring lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1c5dcdb1-10e7-4dbd-8933-e3ef33f55b8a req-4273c8d8-c949-4efa-9ba6-4bd260298b95 service nova] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-1c5dcdb1-10e7-4dbd-8933-e3ef33f55b8a req-4273c8d8-c949-4efa-9ba6-4bd260298b95 service nova] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-1c5dcdb1-10e7-4dbd-8933-e3ef33f55b8a req-4273c8d8-c949-4efa-9ba6-4bd260298b95 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] No waiting events found dispatching network-vif-unplugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG nova.compute.manager [req-1c5dcdb1-10e7-4dbd-8933-e3ef33f55b8a req-4273c8d8-c949-4efa-9ba6-4bd260298b95 service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Received event network-vif-unplugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:24:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Instance destroyed successfully.
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lazy-loading 'resources' on Instance uuid c3816901-3f73-4e5c-b078-a7e78d52ef3d {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:03:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1951994922',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1951994922',id=19,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:03:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7879ba4750fa40cf9ee6bfb1daf85fdf',ramdisk_id='',reservation_id='r-jpqouobm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:05:43Z,user_data=None,user_id='4ca9fb4530574c44b1a3cfa6e1b90871',uuid=c3816901-3f73-4e5c-b078-a7e78d52ef3d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converting VIF {"id": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "address": "fa:16:3e:52:f5:b2", "network": {"id": "8ada2af6-beba-4d3f-acd9-20211328b6ea", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1280151824-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7879ba4750fa40cf9ee6bfb1daf85fdf", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape0349c97-c3", "ovs_interfaceid": "e0349c97-c31d-41dd-96ca-3fd8207d86ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:f5:b2,bridge_name='br-int',has_traffic_filtering=True,id=e0349c97-c31d-41dd-96ca-3fd8207d86ff,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0349c97-c3') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG os_vif [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:f5:b2,bridge_name='br-int',has_traffic_filtering=True,id=e0349c97-c31d-41dd-96ca-3fd8207d86ff,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0349c97-c3') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0349c97-c3, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:15 user nova-compute[73254]: INFO os_vif [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:f5:b2,bridge_name='br-int',has_traffic_filtering=True,id=e0349c97-c31d-41dd-96ca-3fd8207d86ff,network=Network(8ada2af6-beba-4d3f-acd9-20211328b6ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0349c97-c3')
Aug 14 15:24:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Deleting instance files /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d_del
Aug 14 15:24:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Deletion of /opt/stack/data/nova/instances/c3816901-3f73-4e5c-b078-a7e78d52ef3d_del complete
Aug 14 15:24:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:15 user nova-compute[73254]: INFO nova.compute.manager [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 14 15:24:15 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:24:15 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:24:15 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8410MB free_disk=25.058231353759766GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c3816901-3f73-4e5c-b078-a7e78d52ef3d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 7149269a-b4a2-4500-a426-d31dd315a369 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:24:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:16 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Took 0.80 seconds to deallocate network for instance.
Aug 14 15:24:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-c4c77a11-4fec-4fe5-b9d2-33e4db8aadec req-2801d156-7d19-44c2-b63d-38a9494b7aea service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Received event network-vif-deleted-e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:16 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Deleted allocations for instance c3816901-3f73-4e5c-b078-a7e78d52ef3d
Aug 14 15:24:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c4497a3f-dc52-47e4-8d29-682e0aaf9871 tempest-ServerBootFromVolumeStableRescueTest-1955280356 tempest-ServerBootFromVolumeStableRescueTest-1955280356-project-member] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.134s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-d0b52ecf-7a97-43c9-a392-d5abcf592c04 req-97338d71-7577-46c1-b713-c8d9930c88ad service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Received event network-vif-plugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0b52ecf-7a97-43c9-a392-d5abcf592c04 req-97338d71-7577-46c1-b713-c8d9930c88ad service nova] Acquiring lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0b52ecf-7a97-43c9-a392-d5abcf592c04 req-97338d71-7577-46c1-b713-c8d9930c88ad service nova] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0b52ecf-7a97-43c9-a392-d5abcf592c04 req-97338d71-7577-46c1-b713-c8d9930c88ad service nova] Lock "c3816901-3f73-4e5c-b078-a7e78d52ef3d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-d0b52ecf-7a97-43c9-a392-d5abcf592c04 req-97338d71-7577-46c1-b713-c8d9930c88ad service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] No waiting events found dispatching network-vif-plugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:24:16 user nova-compute[73254]: WARNING nova.compute.manager [req-d0b52ecf-7a97-43c9-a392-d5abcf592c04 req-97338d71-7577-46c1-b713-c8d9930c88ad service nova] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Received unexpected event network-vif-plugged-e0349c97-c31d-41dd-96ca-3fd8207d86ff for instance with vm_state deleted and task_state None.
Aug 14 15:24:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:17 user nova-compute[73254]: INFO nova.compute.manager [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attaching volume 77c428c7-9fae-401b-8d4d-017c11765260 to /dev/vdb
Aug 14 15:24:17 user nova-compute[73254]: DEBUG os_brick.utils [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d7521e-51e5-422b-8cef-012e4ef02e5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5636de09-73b1-4ec2-ae0c-2d9a7f0c756f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d27d2d-a219-4213-9ee8-151cd80d6ba6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[be73a315-a3da-4fd6-84e4-221d41b9895e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:24:17 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:24:17 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[90017835-40ee-4043-95c5-ca41841e6e98]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:24:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:24:18 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:24:18 user nova-compute[73254]: DEBUG os_brick.utils [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:24:18 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updating existing volume attachment record: 9417d892-60bc-4410-a6d0-43a43e9874fc {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:24:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 7149269a-b4a2-4500-a426-d31dd315a369 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updating instance_info_cache with network_info: [{"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-7149269a-b4a2-4500-a426-d31dd315a369" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:24:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:25 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:25 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuWsNhpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:24:26 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:24:26 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:24:26 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[131a5c57-accc-4d19-902c-0860677d34aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:24:26 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[217215a1-b70f-427f-b9c7-9397586cc41f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260] added
Aug 14 15:24:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a44ef58-69ee-4194-b900-65757aa22c69]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[054ffaa4-749d-4822-9ca3-cb3d7984c58e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuWsNhpP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuWsNhpP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c066c116-386b-4e18-8f37-2adddb7d0b10]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tuWsNhpP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f387fc-ad8d-44ba-9728-0623de2785f7]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdd0e79-6b08-45d9-ba7f-91ae29c3bb1e]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:24:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:24:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f88c91d-4a7d-4825-b92a-f30167c1e119]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260, portal: 172.16.0.220,3260]
Aug 14 15:24:26 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260, portal: 172.16.0.220,3260] successful.
Aug 14 15:24:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[464838cc-4875-4837-b1b4-c691c7eca2f6]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7421ed-55a9-4a75-b366-be67a1cab399]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:24:26 user nova-compute[73254]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 (non-flash)
Aug 14 15:24:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:24:26 user nova-compute[73254]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 (non-flash)
Aug 14 15:24:26 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e7ee2d-f3ea-4701-9fea-63cc6ff23b3b]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuWsNhpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23830666661316461', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830666661316461', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:24:27 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:24:27 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:24:27 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:24:27 user nova-compute[73254]:   <serial>77c428c7-9fae-401b-8d4d-017c11765260</serial>
Aug 14 15:24:27 user nova-compute[73254]: </disk>
Aug 14 15:24:27 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No VIF found with MAC fa:16:3e:04:fd:db, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:24:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6cb7368b-d1c2-482c-be26-7172a35105d3 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.092s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "7149269a-b4a2-4500-a426-d31dd315a369" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "7149269a-b4a2-4500-a426-d31dd315a369" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "7149269a-b4a2-4500-a426-d31dd315a369-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "7149269a-b4a2-4500-a426-d31dd315a369-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "7149269a-b4a2-4500-a426-d31dd315a369-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:30 user nova-compute[73254]: INFO nova.compute.manager [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Terminating instance
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026655.242952, c3816901-3f73-4e5c-b078-a7e78d52ef3d => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:24:30 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] VM Stopped (Lifecycle Event)
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-4ad32787-7230-412b-be6a-b81fde4a244c None None] [instance: c3816901-3f73-4e5c-b078-a7e78d52ef3d] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-c63b6f13-99df-4bc5-bce1-dab734135d65 req-a31d8520-a5c9-463b-a162-129d0ada53ec service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received event network-vif-unplugged-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c63b6f13-99df-4bc5-bce1-dab734135d65 req-a31d8520-a5c9-463b-a162-129d0ada53ec service nova] Acquiring lock "7149269a-b4a2-4500-a426-d31dd315a369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c63b6f13-99df-4bc5-bce1-dab734135d65 req-a31d8520-a5c9-463b-a162-129d0ada53ec service nova] Lock "7149269a-b4a2-4500-a426-d31dd315a369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c63b6f13-99df-4bc5-bce1-dab734135d65 req-a31d8520-a5c9-463b-a162-129d0ada53ec service nova] Lock "7149269a-b4a2-4500-a426-d31dd315a369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-c63b6f13-99df-4bc5-bce1-dab734135d65 req-a31d8520-a5c9-463b-a162-129d0ada53ec service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] No waiting events found dispatching network-vif-unplugged-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.compute.manager [req-c63b6f13-99df-4bc5-bce1-dab734135d65 req-a31d8520-a5c9-463b-a162-129d0ada53ec service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received event network-vif-unplugged-f088be4d-4968-414e-aca6-6594f9bc2e06 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:24:30 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Instance destroyed successfully.
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lazy-loading 'resources' on Instance uuid 7149269a-b4a2-4500-a426-d31dd315a369 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-852943693',display_name='tempest-ServerActionsTestOtherA-server-852943693',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-852943693',id=22,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHdVC3LG9bN01HlSiMNZhDA0zEYEcGLDrYhPpLJz9ta218GScDSC8eEo3thhKHy7nQaAVL89N9YcF8sXNEgn/eaLjWVETDYOO04B8PSlrVv3eBig80mH0AK7hGooJqv3yA==',key_name='tempest-keypair-384224305',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:05:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a7dd480b32e4059b4d265a6049963e4',ramdisk_id='',reservation_id='r-0xz1edob',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1005131430',owner_user_name='tempest-ServerActionsTestOtherA-1005131430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:05:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e56bbc03d7af4dec928da4d490af7b76',uuid=7149269a-b4a2-4500-a426-d31dd315a369,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converting VIF {"id": "f088be4d-4968-414e-aca6-6594f9bc2e06", "address": "fa:16:3e:3a:ae:8f", "network": {"id": "b3e0f075-2e03-4291-9655-f47e14db468e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1129845591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a7dd480b32e4059b4d265a6049963e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf088be4d-49", "ovs_interfaceid": "f088be4d-4968-414e-aca6-6594f9bc2e06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ae:8f,bridge_name='br-int',has_traffic_filtering=True,id=f088be4d-4968-414e-aca6-6594f9bc2e06,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf088be4d-49') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG os_vif [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ae:8f,bridge_name='br-int',has_traffic_filtering=True,id=f088be4d-4968-414e-aca6-6594f9bc2e06,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf088be4d-49') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf088be4d-49, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:30 user nova-compute[73254]: INFO os_vif [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ae:8f,bridge_name='br-int',has_traffic_filtering=True,id=f088be4d-4968-414e-aca6-6594f9bc2e06,network=Network(b3e0f075-2e03-4291-9655-f47e14db468e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf088be4d-49')
Aug 14 15:24:30 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Deleting instance files /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369_del
Aug 14 15:24:30 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Deletion of /opt/stack/data/nova/instances/7149269a-b4a2-4500-a426-d31dd315a369_del complete
Aug 14 15:24:30 user nova-compute[73254]: INFO nova.compute.manager [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 14 15:24:30 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:24:30 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:24:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:31 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:24:31 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Took 0.62 seconds to deallocate network for instance.
Aug 14 15:24:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:31 user nova-compute[73254]: DEBUG nova.compute.manager [req-fa9bd686-e2e5-4d02-9fb7-802cdcaf02a0 req-b61a4dc9-af91-4d59-b9a7-66bd8f679ac9 service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received event network-vif-deleted-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:24:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:24:31 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:24:31 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:24:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:31 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Deleted allocations for instance 7149269a-b4a2-4500-a426-d31dd315a369
Aug 14 15:24:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7ca6620b-a1ba-4ff1-bac5-4156192d4e84 tempest-ServerActionsTestOtherA-1005131430 tempest-ServerActionsTestOtherA-1005131430-project-member] Lock "7149269a-b4a2-4500-a426-d31dd315a369" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.665s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:32 user nova-compute[73254]: DEBUG nova.compute.manager [req-96719880-cfaf-4c0a-8da2-5aaa072201f9 req-eea81189-d265-45e6-8007-7a3c8ebf4d9c service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received event network-vif-plugged-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:24:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96719880-cfaf-4c0a-8da2-5aaa072201f9 req-eea81189-d265-45e6-8007-7a3c8ebf4d9c service nova] Acquiring lock "7149269a-b4a2-4500-a426-d31dd315a369-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96719880-cfaf-4c0a-8da2-5aaa072201f9 req-eea81189-d265-45e6-8007-7a3c8ebf4d9c service nova] Lock "7149269a-b4a2-4500-a426-d31dd315a369-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-96719880-cfaf-4c0a-8da2-5aaa072201f9 req-eea81189-d265-45e6-8007-7a3c8ebf4d9c service nova] Lock "7149269a-b4a2-4500-a426-d31dd315a369-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:32 user nova-compute[73254]: DEBUG nova.compute.manager [req-96719880-cfaf-4c0a-8da2-5aaa072201f9 req-eea81189-d265-45e6-8007-7a3c8ebf4d9c service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] No waiting events found dispatching network-vif-plugged-f088be4d-4968-414e-aca6-6594f9bc2e06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:24:32 user nova-compute[73254]: WARNING nova.compute.manager [req-96719880-cfaf-4c0a-8da2-5aaa072201f9 req-eea81189-d265-45e6-8007-7a3c8ebf4d9c service nova] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Received unexpected event network-vif-plugged-f088be4d-4968-414e-aca6-6594f9bc2e06 for instance with vm_state deleted and task_state None.
Aug 14 15:24:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:45 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026670.7778778, 7149269a-b4a2-4500-a426-d31dd315a369 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:24:45 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] VM Stopped (Lifecycle Event)
Aug 14 15:24:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-e0984863-6775-4a72-be8a-dd197ebcfd9f None None] [instance: 7149269a-b4a2-4500-a426-d31dd315a369] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:24:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:52 user nova-compute[73254]: INFO nova.compute.manager [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Detaching volume 77c428c7-9fae-401b-8d4d-017c11765260
Aug 14 15:24:52 user nova-compute[73254]: INFO nova.virt.block_device [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attempting to driver detach volume 77c428c7-9fae-401b-8d4d-017c11765260 from mountpoint /dev/vdb
Aug 14 15:24:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Attempting to detach device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:24:52 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:24:52 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:24:52 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:24:52 user nova-compute[73254]:   <serial>77c428c7-9fae-401b-8d4d-017c11765260</serial>
Aug 14 15:24:52 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:24:52 user nova-compute[73254]: </disk>
Aug 14 15:24:52 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:24:52 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Successfully detached device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the persistent domain config.
Aug 14 15:24:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:24:52 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:24:52 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:24:52 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:24:52 user nova-compute[73254]:   <serial>77c428c7-9fae-401b-8d4d-017c11765260</serial>
Aug 14 15:24:52 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:24:52 user nova-compute[73254]: </disk>
Aug 14 15:24:52 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026692.6317818, 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:24:52 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Successfully detached device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the live domain config.
Aug 14 15:24:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuWsNhpP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:24:52 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7362f7-fd8e-4cf9-a6e7-e851145c300f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d98446-14b1-4ccb-9b43-40075c4f3d01]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:24:52 user nova-compute[73254]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 (non-flash)
Aug 14 15:24:52 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:24:52 user nova-compute[73254]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 (non-flash)
Aug 14 15:24:52 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648362dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bee44e-8c17-4d04-8e41-03bf0428ed1c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9d9ce9-70a6-4f5d-bbf6-466ec8533d8b]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5852ea2-015a-4c66-a5c0-bf08637e937d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1049b87f-5591-408d-9a9a-a30b5054cb04]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d297e93-4ec9-408e-a300-cbf6f5cfbcc2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c106c7bc-6b89-4dfc-86fe-f800549712f6]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260, portal: 172.16.0.220,3260]
Aug 14 15:24:52 user nova-compute[73254]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260, portal: 172.16.0.220,3260] successful.
Aug 14 15:24:52 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77c428c7-9fae-401b-8d4d-017c11765260 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d25aa9e-0163-4af7-bd4e-454daba2e23b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== disconnect_volume: return (276ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:24:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:24:53 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:24:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d14d4cf9-45bb-4b29-a015-ca0b002d06a7 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.619s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:24:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:24:57 user nova-compute[73254]: INFO nova.compute.manager [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Unshelving
Aug 14 15:24:57 user nova-compute[73254]: INFO nova.virt.block_device [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Booting with volume d45598e1-71cb-4a83-a537-f45ec99c9254 at /dev/vda
Aug 14 15:24:57 user nova-compute[73254]: DEBUG os_brick.utils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6524590-53b2-4f13-b700-471eea512b71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07a6a6d-0d0d-4312-9abf-91ee9a00c4d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7b1fde-4508-44d7-8f2c-0e95b08166c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc8da20-c1dd-4d1e-ac5c-02cab69c32ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:24:57 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:24:57 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[001e317a-e2e6-4da7-88ce-bd8acc45440d]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG os_brick.utils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:24:57 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating existing volume attachment record: fa92c49c-4be6-42ef-8466-eb1fc4f08efd {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:25:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:25:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:25:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:25:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:25:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:25:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:25:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:25:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:06 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lazy-loading 'pci_requests' on Instance uuid 37e5fe23-df6c-48ba-80af-0c2f866a6447 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:06 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lazy-loading 'numa_topology' on Instance uuid 37e5fe23-df6c-48ba-80af-0c2f866a6447 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:06 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:25:06 user nova-compute[73254]: INFO nova.compute.claims [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Claim successful on node user
Aug 14 15:25:06 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:25:06 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:25:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:06 user nova-compute[73254]: INFO nova.network.neutron [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquired lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-8dfd1059-9e6c-47a2-88fd-bf7ff4bc2120 req-0adf46ab-26b0-491e-ba0d-3e0ddbfecdc9 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-changed-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-8dfd1059-9e6c-47a2-88fd-bf7ff4bc2120 req-0adf46ab-26b0-491e-ba0d-3e0ddbfecdc9 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Refreshing instance network info cache due to event network-changed-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8dfd1059-9e6c-47a2-88fd-bf7ff4bc2120 req-0adf46ab-26b0-491e-ba0d-3e0ddbfecdc9 service nova] Acquiring lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.network.neutron [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating instance_info_cache with network_info: [{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Releasing lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:25:07 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Creating image(s)
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Ensure instance console log exists: /opt/stack/data/nova/instances/37e5fe23-df6c-48ba-80af-0c2f866a6447/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Start _get_guest_xml network_info=[{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fa92c49c-4be6-42ef-8466-eb1fc4f08efd', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTQcKEnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37e5fe23-df6c-48ba-80af-0c2f866a6447', 'attached_at': '', 'detached_at': '', 'volume_id': 'd45598e1-71cb-4a83-a537-f45ec99c9254', 'serial': 'd45598e1-71cb-4a83-a537-f45ec99c9254'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8dfd1059-9e6c-47a2-88fd-bf7ff4bc2120 req-0adf46ab-26b0-491e-ba0d-3e0ddbfecdc9 service nova] Acquired lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.network.neutron [req-8dfd1059-9e6c-47a2-88fd-bf7ff4bc2120 req-0adf46ab-26b0-491e-ba0d-3e0ddbfecdc9 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Refreshing network info cache for port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:25:07 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:25:07 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lazy-loading 'vcpu_model' on Instance uuid 37e5fe23-df6c-48ba-80af-0c2f866a6447 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTQcKEnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:25:07 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:25:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:25:07 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:25:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:25:07 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7feb5f2d-c0c0-48e9-bf9c-412df87ce8ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:25:07 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf2f802-a0bd-49be-acd1-bff735afa718]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254] added
Aug 14 15:25:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[777f1102-5ab5-4aad-86f6-30a29ecfec57]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.035s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d0b53f-4266-4ac9-afcf-8fba5809eec1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTQcKEnX {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xTQcKEnX" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa478a7-b094-4285-8a86-73c3ccb997f2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xTQcKEnX'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9817ea-72f1-4fca-be0f-22dc151b7026]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[54051ce0-50a3-409b-9005-5b0ccdfb9092]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2617bff5-f55d-43ac-9c7e-6693160b1a5d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260]
Aug 14 15:25:08 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260] successful.
Aug 14 15:25:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f434226c-2172-4210-acc8-6d162238cc19]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccfbc66-f4a5-4bc8-8c14-84a74e1016e2]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:08 user nova-compute[73254]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:08 user nova-compute[73254]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcab3ce-b8ff-4c12-85bd-4b6fdfac58dc]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG nova.network.neutron [req-8dfd1059-9e6c-47a2-88fd-bf7ff4bc2120 req-0adf46ab-26b0-491e-ba0d-3e0ddbfecdc9 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updated VIF entry in instance network info cache for port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG nova.network.neutron [req-8dfd1059-9e6c-47a2-88fd-bf7ff4bc2120 req-0adf46ab-26b0-491e-ba0d-3e0ddbfecdc9 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating instance_info_cache with network_info: [{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:25:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-8dfd1059-9e6c-47a2-88fd-bf7ff4bc2120 req-0adf46ab-26b0-491e-ba0d-3e0ddbfecdc9 service nova] Releasing lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTQcKEnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23566313736396466', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566313736396466', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T15:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-725449484',display_name='tempest-TestShelveInstance-server-725449484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-725449484',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1809884015',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4b77df2a55974cec9ee846a3d2166131',ramdisk_id='',reservation_id='r-ehw0yruh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-500249239',owner_user_name='tempest-TestShelveInstance-500249239-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:24:58Z,user_data=None,user_id='dff145de66554050ade3990af9aba7fa',uuid=37e5fe23-df6c-48ba-80af-0c2f866a6447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converting VIF {"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lazy-loading 'pci_devices' on Instance uuid 37e5fe23-df6c-48ba-80af-0c2f866a6447 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:25:09 user nova-compute[73254]:   <uuid>37e5fe23-df6c-48ba-80af-0c2f866a6447</uuid>
Aug 14 15:25:09 user nova-compute[73254]:   <name>instance-00000028</name>
Aug 14 15:25:09 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:25:09 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:25:09 user nova-compute[73254]:   <metadata>
Aug 14 15:25:09 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:25:09 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:25:09 user nova-compute[73254]:       <nova:name>tempest-TestShelveInstance-server-725449484</nova:name>
Aug 14 15:25:09 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:25:07</nova:creationTime>
Aug 14 15:25:09 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:25:09 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:25:09 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:25:09 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:25:09 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:25:09 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:25:09 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:25:09 user nova-compute[73254]:       <nova:owner>
Aug 14 15:25:09 user nova-compute[73254]:         <nova:user uuid="dff145de66554050ade3990af9aba7fa">tempest-TestShelveInstance-500249239-project-member</nova:user>
Aug 14 15:25:09 user nova-compute[73254]:         <nova:project uuid="4b77df2a55974cec9ee846a3d2166131">tempest-TestShelveInstance-500249239</nova:project>
Aug 14 15:25:09 user nova-compute[73254]:       </nova:owner>
Aug 14 15:25:09 user nova-compute[73254]:       <nova:ports>
Aug 14 15:25:09 user nova-compute[73254]:         <nova:port uuid="67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f">
Aug 14 15:25:09 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 15:25:09 user nova-compute[73254]:         </nova:port>
Aug 14 15:25:09 user nova-compute[73254]:       </nova:ports>
Aug 14 15:25:09 user nova-compute[73254]:     </nova:instance>
Aug 14 15:25:09 user nova-compute[73254]:   </metadata>
Aug 14 15:25:09 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:25:09 user nova-compute[73254]:     <system>
Aug 14 15:25:09 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:25:09 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:25:09 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:25:09 user nova-compute[73254]:       <entry name="serial">37e5fe23-df6c-48ba-80af-0c2f866a6447</entry>
Aug 14 15:25:09 user nova-compute[73254]:       <entry name="uuid">37e5fe23-df6c-48ba-80af-0c2f866a6447</entry>
Aug 14 15:25:09 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:25:09 user nova-compute[73254]:     </system>
Aug 14 15:25:09 user nova-compute[73254]:   </sysinfo>
Aug 14 15:25:09 user nova-compute[73254]:   <os>
Aug 14 15:25:09 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:25:09 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:25:09 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:25:09 user nova-compute[73254]:   </os>
Aug 14 15:25:09 user nova-compute[73254]:   <features>
Aug 14 15:25:09 user nova-compute[73254]:     <acpi/>
Aug 14 15:25:09 user nova-compute[73254]:     <apic/>
Aug 14 15:25:09 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:25:09 user nova-compute[73254]:   </features>
Aug 14 15:25:09 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:25:09 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:25:09 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:25:09 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:25:09 user nova-compute[73254]:   </clock>
Aug 14 15:25:09 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:25:09 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:25:09 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:25:09 user nova-compute[73254]:   </cpu>
Aug 14 15:25:09 user nova-compute[73254]:   <devices>
Aug 14 15:25:09 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:25:09 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:25:09 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 15:25:09 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:25:09 user nova-compute[73254]:       <serial>d45598e1-71cb-4a83-a537-f45ec99c9254</serial>
Aug 14 15:25:09 user nova-compute[73254]:     </disk>
Aug 14 15:25:09 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:25:09 user nova-compute[73254]:       <mac address="fa:16:3e:a6:3e:fb"/>
Aug 14 15:25:09 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:25:09 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:25:09 user nova-compute[73254]:       <target dev="tap67f9ad46-1b"/>
Aug 14 15:25:09 user nova-compute[73254]:     </interface>
Aug 14 15:25:09 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:25:09 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/37e5fe23-df6c-48ba-80af-0c2f866a6447/console.log" append="off"/>
Aug 14 15:25:09 user nova-compute[73254]:     </serial>
Aug 14 15:25:09 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:25:09 user nova-compute[73254]:     <video>
Aug 14 15:25:09 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:25:09 user nova-compute[73254]:     </video>
Aug 14 15:25:09 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:25:09 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:25:09 user nova-compute[73254]:     </rng>
Aug 14 15:25:09 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:25:09 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:25:09 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:25:09 user nova-compute[73254]:     </memballoon>
Aug 14 15:25:09 user nova-compute[73254]:   </devices>
Aug 14 15:25:09 user nova-compute[73254]: </domain>
Aug 14 15:25:09 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T15:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-725449484',display_name='tempest-TestShelveInstance-server-725449484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-725449484',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1809884015',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:21:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='4b77df2a55974cec9ee846a3d2166131',ramdisk_id='',reservation_id='r-ehw0yruh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-500249239',owner_user_name='tempest-TestShelveInstance-500249239-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:24:58Z,user_data=None,user_id='dff145de66554050ade3990af9aba7fa',uuid=37e5fe23-df6c-48ba-80af-0c2f866a6447,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converting VIF {"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG os_vif [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67f9ad46-1b, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap67f9ad46-1b, col_values=(('external_ids', {'iface-id': '67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:3e:fb', 'vm-uuid': '37e5fe23-df6c-48ba-80af-0c2f866a6447'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:09 user nova-compute[73254]: INFO os_vif [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b')
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:25:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] No VIF found with MAC fa:16:3e:a6:3e:fb, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:25:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c4e2fc02-82b2-4c24-95ef-a85ebc331e02 req-98a6636d-45e0-4fdb-9387-1f2590b8bd50 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c4e2fc02-82b2-4c24-95ef-a85ebc331e02 req-98a6636d-45e0-4fdb-9387-1f2590b8bd50 service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c4e2fc02-82b2-4c24-95ef-a85ebc331e02 req-98a6636d-45e0-4fdb-9387-1f2590b8bd50 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c4e2fc02-82b2-4c24-95ef-a85ebc331e02 req-98a6636d-45e0-4fdb-9387-1f2590b8bd50 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-c4e2fc02-82b2-4c24-95ef-a85ebc331e02 req-98a6636d-45e0-4fdb-9387-1f2590b8bd50 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:25:11 user nova-compute[73254]: WARNING nova.compute.manager [req-c4e2fc02-82b2-4c24-95ef-a85ebc331e02 req-98a6636d-45e0-4fdb-9387-1f2590b8bd50 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received unexpected event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with vm_state shelved_offloaded and task_state spawning.
Aug 14 15:25:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquired lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG nova.network.neutron [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:25:11 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'info_cache' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.network.neutron [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updating instance_info_cache with network_info: [{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Releasing lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:25:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance destroyed successfully.
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'resources' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-16733886',display_name='tempest-AttachVolumeTestJSON-server-16733886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-16733886',id=41,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxEAZaymEwwljUUm0bIND6+g7UStk6ayOY0oDvHBPzJ7vBCL0k+kKVFgHuWCAyGaHw+gdORl3+kdPOLWn88b3xmGLjBfM0KROLhtVxvGAVzsR9I/6NAtKreWeWvrEUlw==',key_name='tempest-keypair-1829711365',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-kumsk06a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=e94cdb72-c3cd-4d1f-a50f-934c2d9218f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_vif [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e972792-34, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:25:12 user nova-compute[73254]: INFO os_vif [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34')
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGSnHLMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:25:12 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba44dac-9410-4467-9105-4159eaa9ec89]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7184e3-d3ff-41fd-8db1-9a96ddcd3fdd]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:12 user nova-compute[73254]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:12 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:12 user nova-compute[73254]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:12 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648362f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26'): ({'sdd'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Removing single pathed devices sdd {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4262856d-1295-4510-94bb-30c205ca7b72]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e76590c-f150-438d-968f-e94c10dd7f1d]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flushing IO for device /dev/sdd {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55617ec-59e9-44e8-85f3-ffc98325dc33]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e3c786-465a-4ba7-bdd7-9e560b3ed581]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a330928d-eb83-473f-8554-43ca2e860ae6]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fdbcf47-8fca-4126-9ea7-c05481aed644]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260]
Aug 14 15:25:12 user nova-compute[73254]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260] successful.
Aug 14 15:25:12 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fced13b-1dd3-4e27-9955-c80d7439ff10]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== disconnect_volume: return (266ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Start _get_guest_xml network_info=[{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '77eb477b-1638-47af-adb6-650523ccf841', 'disk_bus': 'virtio', 'boot_index': None, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGSnHLMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'e94cdb72-c3cd-4d1f-a50f-934c2d9218f1', 'attached_at': '', 'detached_at': '', 'volume_id': '2c8ccb90-0f4a-4999-b3be-c82f1addfa26', 'serial': '2c8ccb90-0f4a-4999-b3be-c82f1addfa26'}, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'numa_topology' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:25:12 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'vcpu_model' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGSnHLMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:25:12 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:25:12 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:25:12 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[396d8574-af7c-4239-8194-e0a0abdab5be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:25:12 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cb9a32-3d6f-4f32-bf10-c4b96f5d0645]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26] added
Aug 14 15:25:12 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026712.865581, 37e5fe23-df6c-48ba-80af-0c2f866a6447 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:25:12 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] VM Resumed (Lifecycle Event)
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d0301-f9f0-45b8-87c6-04dcf1f5ad58]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Instance spawned successfully.
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f34c5e-8d7e-4a06-8c90-0e4f6cd7e169]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGSnHLMx {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026712.868741, 37e5fe23-df6c-48ba-80af-0c2f866a6447 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:25:12 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] VM Started (Lifecycle Event)
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NGSnHLMx" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef860dd5-b585-4b6e-8767-0d76618656fa]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NGSnHLMx'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ddfcb4-0e8b-4bd2-b302-e59b0b9a6fde]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c2d0e758-0b08-4175-8b92-623b6f492d62 tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.432s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce49002d-15f9-4055-ad56-9827aacf8cbb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:12 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:12 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:25:12 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[068dd59d-a521-47cb-b52d-363d553fa5d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260]
Aug 14 15:25:13 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260] successful.
Aug 14 15:25:13 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d92633e-9110-4824-9d7f-dd3eeb63aa16]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16f33b1-aad7-4bcd-afee-a473a58a374f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:13 user nova-compute[73254]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:13 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:13 user nova-compute[73254]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:13 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cb890c-5f2b-4a75-9592-e10e56ca89e7]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGSnHLMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-d1afe6ab-479c-4ee6-bf1e-9fc2d66d2b17 req-3644e462-a24f-4470-a1a9-5a0eeaa0bd7d service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d1afe6ab-479c-4ee6-bf1e-9fc2d66d2b17 req-3644e462-a24f-4470-a1a9-5a0eeaa0bd7d service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d1afe6ab-479c-4ee6-bf1e-9fc2d66d2b17 req-3644e462-a24f-4470-a1a9-5a0eeaa0bd7d service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d1afe6ab-479c-4ee6-bf1e-9fc2d66d2b17 req-3644e462-a24f-4470-a1a9-5a0eeaa0bd7d service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-d1afe6ab-479c-4ee6-bf1e-9fc2d66d2b17 req-3644e462-a24f-4470-a1a9-5a0eeaa0bd7d service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:25:13 user nova-compute[73254]: WARNING nova.compute.manager [req-d1afe6ab-479c-4ee6-bf1e-9fc2d66d2b17 req-3644e462-a24f-4470-a1a9-5a0eeaa0bd7d service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received unexpected event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with vm_state active and task_state None.
Aug 14 15:25:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23938353262323863', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938353262323863', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-16733886',display_name='tempest-AttachVolumeTestJSON-server-16733886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-16733886',id=41,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxEAZaymEwwljUUm0bIND6+g7UStk6ayOY0oDvHBPzJ7vBCL0k+kKVFgHuWCAyGaHw+gdORl3+kdPOLWn88b3xmGLjBfM0KROLhtVxvGAVzsR9I/6NAtKreWeWvrEUlw==',key_name='tempest-keypair-1829711365',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-kumsk06a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=e94cdb72-c3cd-4d1f-a50f-934c2d9218f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'pci_devices' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:25:14 user nova-compute[73254]:   <uuid>e94cdb72-c3cd-4d1f-a50f-934c2d9218f1</uuid>
Aug 14 15:25:14 user nova-compute[73254]:   <name>instance-00000029</name>
Aug 14 15:25:14 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:25:14 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:25:14 user nova-compute[73254]:   <metadata>
Aug 14 15:25:14 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:25:14 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:25:14 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeTestJSON-server-16733886</nova:name>
Aug 14 15:25:14 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:25:12</nova:creationTime>
Aug 14 15:25:14 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:25:14 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:25:14 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:25:14 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:25:14 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:25:14 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:25:14 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:25:14 user nova-compute[73254]:       <nova:owner>
Aug 14 15:25:14 user nova-compute[73254]:         <nova:user uuid="4518a054567744089ed8477a58377821">tempest-AttachVolumeTestJSON-395337043-project-member</nova:user>
Aug 14 15:25:14 user nova-compute[73254]:         <nova:project uuid="05958df454f94ce5acc81cf06b929d27">tempest-AttachVolumeTestJSON-395337043</nova:project>
Aug 14 15:25:14 user nova-compute[73254]:       </nova:owner>
Aug 14 15:25:14 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:25:14 user nova-compute[73254]:       <nova:ports>
Aug 14 15:25:14 user nova-compute[73254]:         <nova:port uuid="8e972792-3462-4547-84e7-bc0b50c37b06">
Aug 14 15:25:14 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 15:25:14 user nova-compute[73254]:         </nova:port>
Aug 14 15:25:14 user nova-compute[73254]:       </nova:ports>
Aug 14 15:25:14 user nova-compute[73254]:     </nova:instance>
Aug 14 15:25:14 user nova-compute[73254]:   </metadata>
Aug 14 15:25:14 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:25:14 user nova-compute[73254]:     <system>
Aug 14 15:25:14 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:25:14 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:25:14 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:25:14 user nova-compute[73254]:       <entry name="serial">e94cdb72-c3cd-4d1f-a50f-934c2d9218f1</entry>
Aug 14 15:25:14 user nova-compute[73254]:       <entry name="uuid">e94cdb72-c3cd-4d1f-a50f-934c2d9218f1</entry>
Aug 14 15:25:14 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:25:14 user nova-compute[73254]:     </system>
Aug 14 15:25:14 user nova-compute[73254]:   </sysinfo>
Aug 14 15:25:14 user nova-compute[73254]:   <os>
Aug 14 15:25:14 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:25:14 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:25:14 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:25:14 user nova-compute[73254]:   </os>
Aug 14 15:25:14 user nova-compute[73254]:   <features>
Aug 14 15:25:14 user nova-compute[73254]:     <acpi/>
Aug 14 15:25:14 user nova-compute[73254]:     <apic/>
Aug 14 15:25:14 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:25:14 user nova-compute[73254]:   </features>
Aug 14 15:25:14 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:25:14 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:25:14 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:25:14 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:25:14 user nova-compute[73254]:   </clock>
Aug 14 15:25:14 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:25:14 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:25:14 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:25:14 user nova-compute[73254]:   </cpu>
Aug 14 15:25:14 user nova-compute[73254]:   <devices>
Aug 14 15:25:14 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:25:14 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:25:14 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk"/>
Aug 14 15:25:14 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:25:14 user nova-compute[73254]:     </disk>
Aug 14 15:25:14 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:25:14 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:25:14 user nova-compute[73254]:       <source dev="/dev/sdc"/>
Aug 14 15:25:14 user nova-compute[73254]:       <target dev="vdb" bus="virtio"/>
Aug 14 15:25:14 user nova-compute[73254]:       <serial>2c8ccb90-0f4a-4999-b3be-c82f1addfa26</serial>
Aug 14 15:25:14 user nova-compute[73254]:     </disk>
Aug 14 15:25:14 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:25:14 user nova-compute[73254]:       <mac address="fa:16:3e:5b:40:78"/>
Aug 14 15:25:14 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:25:14 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:25:14 user nova-compute[73254]:       <target dev="tap8e972792-34"/>
Aug 14 15:25:14 user nova-compute[73254]:     </interface>
Aug 14 15:25:14 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:25:14 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/console.log" append="off"/>
Aug 14 15:25:14 user nova-compute[73254]:     </serial>
Aug 14 15:25:14 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:25:14 user nova-compute[73254]:     <video>
Aug 14 15:25:14 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:25:14 user nova-compute[73254]:     </video>
Aug 14 15:25:14 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:25:14 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:25:14 user nova-compute[73254]:     </rng>
Aug 14 15:25:14 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:25:14 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:25:14 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:25:14 user nova-compute[73254]:     </memballoon>
Aug 14 15:25:14 user nova-compute[73254]:   </devices>
Aug 14 15:25:14 user nova-compute[73254]: </domain>
Aug 14 15:25:14 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'trusted_certs' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.199s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Cannot resize image /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:25:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'migration_context' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-16733886',display_name='tempest-AttachVolumeTestJSON-server-16733886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-16733886',id=41,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxEAZaymEwwljUUm0bIND6+g7UStk6ayOY0oDvHBPzJ7vBCL0k+kKVFgHuWCAyGaHw+gdORl3+kdPOLWn88b3xmGLjBfM0KROLhtVxvGAVzsR9I/6NAtKreWeWvrEUlw==',key_name='tempest-keypair-1829711365',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-kumsk06a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:23:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=e94cdb72-c3cd-4d1f-a50f-934c2d9218f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG os_vif [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e972792-34, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e972792-34, col_values=(('external_ids', {'iface-id': '8e972792-3462-4547-84e7-bc0b50c37b06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:40:78', 'vm-uuid': 'e94cdb72-c3cd-4d1f-a50f-934c2d9218f1'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:15 user nova-compute[73254]: INFO os_vif [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34')
Aug 14 15:25:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:15 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:25:15 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:25:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8522MB free_disk=25.19266128540039GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 37e5fe23-df6c-48ba-80af-0c2f866a6447 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:25:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-b92b2536-55da-4c90-8e25-90f29df7a956 req-46415426-c061-440a-b1c3-2ff5c511667d service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b92b2536-55da-4c90-8e25-90f29df7a956 req-46415426-c061-440a-b1c3-2ff5c511667d service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b92b2536-55da-4c90-8e25-90f29df7a956 req-46415426-c061-440a-b1c3-2ff5c511667d service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b92b2536-55da-4c90-8e25-90f29df7a956 req-46415426-c061-440a-b1c3-2ff5c511667d service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:16 user nova-compute[73254]: DEBUG nova.compute.manager [req-b92b2536-55da-4c90-8e25-90f29df7a956 req-46415426-c061-440a-b1c3-2ff5c511667d service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:25:16 user nova-compute[73254]: WARNING nova.compute.manager [req-b92b2536-55da-4c90-8e25-90f29df7a956 req-46415426-c061-440a-b1c3-2ff5c511667d service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state stopped and task_state powering-on.
Aug 14 15:25:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:18 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026718.824572, e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:25:18 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] VM Resumed (Lifecycle Event)
Aug 14 15:25:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-3d2c15d8-0997-4c33-82de-b397941fe89f req-4e999eca-9add-4273-a90b-8a062d5dc4b5 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:25:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3d2c15d8-0997-4c33-82de-b397941fe89f req-4e999eca-9add-4273-a90b-8a062d5dc4b5 service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3d2c15d8-0997-4c33-82de-b397941fe89f req-4e999eca-9add-4273-a90b-8a062d5dc4b5 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3d2c15d8-0997-4c33-82de-b397941fe89f req-4e999eca-9add-4273-a90b-8a062d5dc4b5 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:18 user nova-compute[73254]: DEBUG nova.compute.manager [req-3d2c15d8-0997-4c33-82de-b397941fe89f req-4e999eca-9add-4273-a90b-8a062d5dc4b5 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:25:18 user nova-compute[73254]: WARNING nova.compute.manager [req-3d2c15d8-0997-4c33-82de-b397941fe89f req-4e999eca-9add-4273-a90b-8a062d5dc4b5 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state stopped and task_state powering-on.
Aug 14 15:25:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:25:18 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance rebooted successfully.
Aug 14 15:25:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-b3958982-35a1-481c-be2e-47062f84c11c tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:25:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:25:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:25:18 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026718.828616, e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:25:18 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] VM Started (Lifecycle Event)
Aug 14 15:25:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:25:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:25:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updating instance_info_cache with network_info: [{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:25:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:25:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:25 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:25:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:25:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:25:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:46 user nova-compute[73254]: INFO nova.compute.manager [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attaching volume 68fa4706-d320-4a69-91b0-5e085a3d330d to /dev/vdb
Aug 14 15:25:46 user nova-compute[73254]: DEBUG os_brick.utils [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d740969-2951-42fa-a14e-d4e29b2ce2c3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee08cc3-c359-408a-a6a4-1b45d8a3eca7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[295fe626-b754-4529-9022-559cd4ccf5c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7bd4ac-c9c4-46de-96c3-32a68d2ce796]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:25:46 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:25:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[38de2c6a-7db6-4236-a948-95aef54650fe]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG os_brick.utils [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:25:46 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updating existing volume attachment record: a202aeb2-f7a6-4295-a706-b2523cac6184 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:25:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjNAQrpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:25:55 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:25:55 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:25:55 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[650f0d77-e8ad-482c-86a3-2833e8392929]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:25:55 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7bad89-2b61-4086-b47b-45563d290f7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d] added
Aug 14 15:25:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8ab81b-060f-4b16-b8a0-6e3c8d1c7cf5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc063038-3589-427f-a80c-a11d12d9574b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjNAQrpx {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OjNAQrpx" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7dc306-286a-4ce5-aeff-76899af1a071]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OjNAQrpx'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a1e3f7-51a5-4ec0-a6a5-9c303cf0e76f]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb1aeb1-eadc-4855-84a3-fc2175631bfc]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:55 user nova-compute[73254]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:55 user nova-compute[73254]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa1c8c3-406d-4127-9e0e-32f778553e07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d, portal: 172.16.0.220,3260]
Aug 14 15:25:55 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d, portal: 172.16.0.220,3260] successful.
Aug 14 15:25:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d909f2-b011-4cdb-bf11-bba6d143b214]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d65afd-79bf-4779-b835-e48b523c4694]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:55 user nova-compute[73254]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:55 user nova-compute[73254]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d (non-flash)
Aug 14 15:25:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:25:55 user nova-compute[73254]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:25:55 user nova-compute[73254]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d (non-flash)
Aug 14 15:25:55 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[807f99ed-0870-46a3-aac7-9c51d38d4669]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:25:55 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:25:56 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:25:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjNAQrpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:25:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:25:56 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23266643539653635', 'path': '/dev/sdd'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:25:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23266643539653635', 'path': '/dev/sdd'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:25:56 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:25:56 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:25:56 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:25:56 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:25:56 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:25:56 user nova-compute[73254]:   <serial>68fa4706-d320-4a69-91b0-5e085a3d330d</serial>
Aug 14 15:25:56 user nova-compute[73254]: </disk>
Aug 14 15:25:56 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:25:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:25:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:25:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No VIF found with MAC fa:16:3e:04:fd:db, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:25:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5231da9-1453-49d9-aed5-e5952d41e21f tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.898s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:25:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:25:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:25:59 user nova-compute[73254]: INFO nova.compute.manager [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Detaching volume 68fa4706-d320-4a69-91b0-5e085a3d330d
Aug 14 15:25:59 user nova-compute[73254]: INFO nova.virt.block_device [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attempting to driver detach volume 68fa4706-d320-4a69-91b0-5e085a3d330d from mountpoint /dev/vdb
Aug 14 15:25:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Attempting to detach device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:25:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:25:59 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:25:59 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:25:59 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:25:59 user nova-compute[73254]:   <serial>68fa4706-d320-4a69-91b0-5e085a3d330d</serial>
Aug 14 15:25:59 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:25:59 user nova-compute[73254]: </disk>
Aug 14 15:25:59 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:25:59 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Successfully detached device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the persistent domain config.
Aug 14 15:25:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:25:59 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:25:59 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:25:59 user nova-compute[73254]:   <source dev="/dev/sdd"/>
Aug 14 15:25:59 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:25:59 user nova-compute[73254]:   <serial>68fa4706-d320-4a69-91b0-5e085a3d330d</serial>
Aug 14 15:25:59 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:25:59 user nova-compute[73254]: </disk>
Aug 14 15:25:59 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026760.3698056, 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:26:00 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Successfully detached device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the live domain config.
Aug 14 15:26:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OjNAQrpx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:26:00 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[536b2a69-33a1-4453-ad12-490fc35592e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e98e6ed-54f1-4065-b27b-eb648b68506d]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:26:00 user nova-compute[73254]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:26:00 user nova-compute[73254]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d (non-flash)
Aug 14 15:26:00 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:26:00 user nova-compute[73254]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:26:00 user nova-compute[73254]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d (non-flash)
Aug 14 15:26:00 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd668325750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d'): ({'sdd'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Removing single pathed devices sdd {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc9e881-b967-4cfe-bb03-9002b8e013e6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[031bf767-31c4-4dbe-ad42-97a3a98a8dd5]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Flushing IO for device /dev/sdd {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9dc6fc-33e6-4bdf-aed1-ee3ab0d10f0c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d630d712-5b67-4d5d-9a77-0add9772f0fb]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] SCSI volumes sdd have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e105bed-c344-41d3-a85d-a1850551ccaa]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2143d626-4388-430f-b09f-3102d6b61cbc]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d, portal: 172.16.0.220,3260]
Aug 14 15:26:00 user nova-compute[73254]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d, portal: 172.16.0.220,3260] successful.
Aug 14 15:26:00 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68fa4706-d320-4a69-91b0-5e085a3d330d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d951d3e-711d-4721-8c18-cf231a98d138]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== disconnect_volume: return (293ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:26:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:26:01 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:26:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5e256c89-f453-4053-a73c-93268e3c77d1 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.700s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:26:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:26:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:16 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:26:16 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:26:16 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8388MB free_disk=25.180370330810547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:26:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 37e5fe23-df6c-48ba-80af-0c2f866a6447 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:26:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.390s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:26:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:26:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:26:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:26:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:26:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:26:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:26:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:26:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:26:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:26:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:26:21 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:26:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:22 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updating instance_info_cache with network_info: [{"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:26:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:26:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:26:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:26:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:26:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:26:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:26:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:26:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:26:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:26:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.285s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:26:36 user nova-compute[73254]: INFO nova.compute.claims [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Claim successful on node user
Aug 14 15:26:36 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.249s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:26:36 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:26:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG nova.policy [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '042cc963edc04bfdb686a5dbc46b6be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c518b42c3374a189e3cb99cd31d2d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:26:36 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Creating image(s)
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "/opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "/opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.168s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.173s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk 1073741824" returned: 0 in 0.048s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:36 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.196s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Successfully created port: 3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Cannot resize image /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lazy-loading 'migration_context' on Instance uuid fcbc9f15-0f34-43b5-ad97-66c126e81405 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Ensure instance console log exists: /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Successfully updated port: 3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquired lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:26:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-861e1d8e-1d03-4c88-8abb-35667d2189b5 req-04950294-bc05-474e-8dbf-6a544ca1cf6f service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received event network-changed-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.compute.manager [req-861e1d8e-1d03-4c88-8abb-35667d2189b5 req-04950294-bc05-474e-8dbf-6a544ca1cf6f service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Refreshing instance network info cache due to event network-changed-3a5860c4-3ed4-456c-8153-651e38223174. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-861e1d8e-1d03-4c88-8abb-35667d2189b5 req-04950294-bc05-474e-8dbf-6a544ca1cf6f service nova] Acquiring lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Updating instance_info_cache with network_info: [{"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Releasing lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Instance network_info: |[{"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-861e1d8e-1d03-4c88-8abb-35667d2189b5 req-04950294-bc05-474e-8dbf-6a544ca1cf6f service nova] Acquired lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.network.neutron [req-861e1d8e-1d03-4c88-8abb-35667d2189b5 req-04950294-bc05-474e-8dbf-6a544ca1cf6f service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Refreshing network info cache for port 3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Start _get_guest_xml network_info=[{"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:26:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:26:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-289094552',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-289094552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2890945',id=43,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhBamXk4if668C496OvO0pB90mC74AWv4bCb9skWqN12nuvAdmEQMI1vr2mdC3xOSrm1cdllxIXJRwScMlyN9kwXjw+HD5rlUxzBTwvKINmFSddbBhRh2Z7lnrIa65GIQ==',key_name='tempest-keypair-1704929400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c518b42c3374a189e3cb99cd31d2d02',ramdisk_id='',reservation_id='r-3e2i70qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1925171100',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:26:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='042cc963edc04bfdb686a5dbc46b6be9',uuid=fcbc9f15-0f34-43b5-ad97-66c126e81405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Converting VIF {"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5860c4-3ed4-456c-8153-651e38223174,network=Network(6f824e0b-5d92-4a6f-8348-451d28fd7c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5860c4-3e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lazy-loading 'pci_devices' on Instance uuid fcbc9f15-0f34-43b5-ad97-66c126e81405 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:26:38 user nova-compute[73254]:   <uuid>fcbc9f15-0f34-43b5-ad97-66c126e81405</uuid>
Aug 14 15:26:38 user nova-compute[73254]:   <name>instance-0000002b</name>
Aug 14 15:26:38 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:26:38 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:26:38 user nova-compute[73254]:   <metadata>
Aug 14 15:26:38 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:26:38 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:26:38 user nova-compute[73254]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-289094552</nova:name>
Aug 14 15:26:38 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:26:38</nova:creationTime>
Aug 14 15:26:38 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:26:38 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:26:38 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:26:38 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:26:38 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:26:38 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:26:38 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:26:38 user nova-compute[73254]:       <nova:owner>
Aug 14 15:26:38 user nova-compute[73254]:         <nova:user uuid="042cc963edc04bfdb686a5dbc46b6be9">tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member</nova:user>
Aug 14 15:26:38 user nova-compute[73254]:         <nova:project uuid="9c518b42c3374a189e3cb99cd31d2d02">tempest-TestServerVolumeAttachScenarioOldVersion-1925171100</nova:project>
Aug 14 15:26:38 user nova-compute[73254]:       </nova:owner>
Aug 14 15:26:38 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:26:38 user nova-compute[73254]:       <nova:ports>
Aug 14 15:26:38 user nova-compute[73254]:         <nova:port uuid="3a5860c4-3ed4-456c-8153-651e38223174">
Aug 14 15:26:38 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 14 15:26:38 user nova-compute[73254]:         </nova:port>
Aug 14 15:26:38 user nova-compute[73254]:       </nova:ports>
Aug 14 15:26:38 user nova-compute[73254]:     </nova:instance>
Aug 14 15:26:38 user nova-compute[73254]:   </metadata>
Aug 14 15:26:38 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:26:38 user nova-compute[73254]:     <system>
Aug 14 15:26:38 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:26:38 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:26:38 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:26:38 user nova-compute[73254]:       <entry name="serial">fcbc9f15-0f34-43b5-ad97-66c126e81405</entry>
Aug 14 15:26:38 user nova-compute[73254]:       <entry name="uuid">fcbc9f15-0f34-43b5-ad97-66c126e81405</entry>
Aug 14 15:26:38 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:26:38 user nova-compute[73254]:     </system>
Aug 14 15:26:38 user nova-compute[73254]:   </sysinfo>
Aug 14 15:26:38 user nova-compute[73254]:   <os>
Aug 14 15:26:38 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:26:38 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:26:38 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:26:38 user nova-compute[73254]:   </os>
Aug 14 15:26:38 user nova-compute[73254]:   <features>
Aug 14 15:26:38 user nova-compute[73254]:     <acpi/>
Aug 14 15:26:38 user nova-compute[73254]:     <apic/>
Aug 14 15:26:38 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:26:38 user nova-compute[73254]:   </features>
Aug 14 15:26:38 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:26:38 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:26:38 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:26:38 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:26:38 user nova-compute[73254]:   </clock>
Aug 14 15:26:38 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:26:38 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:26:38 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:26:38 user nova-compute[73254]:   </cpu>
Aug 14 15:26:38 user nova-compute[73254]:   <devices>
Aug 14 15:26:38 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:26:38 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:26:38 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk"/>
Aug 14 15:26:38 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:26:38 user nova-compute[73254]:     </disk>
Aug 14 15:26:38 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:26:38 user nova-compute[73254]:       <mac address="fa:16:3e:73:cc:95"/>
Aug 14 15:26:38 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:26:38 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:26:38 user nova-compute[73254]:       <target dev="tap3a5860c4-3e"/>
Aug 14 15:26:38 user nova-compute[73254]:     </interface>
Aug 14 15:26:38 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:26:38 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/console.log" append="off"/>
Aug 14 15:26:38 user nova-compute[73254]:     </serial>
Aug 14 15:26:38 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:26:38 user nova-compute[73254]:     <video>
Aug 14 15:26:38 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:26:38 user nova-compute[73254]:     </video>
Aug 14 15:26:38 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:26:38 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:26:38 user nova-compute[73254]:     </rng>
Aug 14 15:26:38 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:26:38 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:26:38 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:26:38 user nova-compute[73254]:     </memballoon>
Aug 14 15:26:38 user nova-compute[73254]:   </devices>
Aug 14 15:26:38 user nova-compute[73254]: </domain>
Aug 14 15:26:38 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-289094552',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-289094552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2890945',id=43,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhBamXk4if668C496OvO0pB90mC74AWv4bCb9skWqN12nuvAdmEQMI1vr2mdC3xOSrm1cdllxIXJRwScMlyN9kwXjw+HD5rlUxzBTwvKINmFSddbBhRh2Z7lnrIa65GIQ==',key_name='tempest-keypair-1704929400',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9c518b42c3374a189e3cb99cd31d2d02',ramdisk_id='',reservation_id='r-3e2i70qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1925171100',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:26:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='042cc963edc04bfdb686a5dbc46b6be9',uuid=fcbc9f15-0f34-43b5-ad97-66c126e81405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Converting VIF {"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5860c4-3ed4-456c-8153-651e38223174,network=Network(6f824e0b-5d92-4a6f-8348-451d28fd7c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5860c4-3e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG os_vif [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5860c4-3ed4-456c-8153-651e38223174,network=Network(6f824e0b-5d92-4a6f-8348-451d28fd7c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5860c4-3e') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a5860c4-3e, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a5860c4-3e, col_values=(('external_ids', {'iface-id': '3a5860c4-3ed4-456c-8153-651e38223174', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:cc:95', 'vm-uuid': 'fcbc9f15-0f34-43b5-ad97-66c126e81405'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:38 user nova-compute[73254]: INFO os_vif [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5860c4-3ed4-456c-8153-651e38223174,network=Network(6f824e0b-5d92-4a6f-8348-451d28fd7c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5860c4-3e')
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] No VIF found with MAC fa:16:3e:73:cc:95, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.network.neutron [req-861e1d8e-1d03-4c88-8abb-35667d2189b5 req-04950294-bc05-474e-8dbf-6a544ca1cf6f service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Updated VIF entry in instance network info cache for port 3a5860c4-3ed4-456c-8153-651e38223174. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG nova.network.neutron [req-861e1d8e-1d03-4c88-8abb-35667d2189b5 req-04950294-bc05-474e-8dbf-6a544ca1cf6f service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Updating instance_info_cache with network_info: [{"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:26:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-861e1d8e-1d03-4c88-8abb-35667d2189b5 req-04950294-bc05-474e-8dbf-6a544ca1cf6f service nova] Releasing lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:26:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-98a1d95b-38fe-499b-ba2c-7e4a80a66353 req-67a0e336-d507-4a64-ab99-9b3d5a3c7c9d service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received event network-vif-plugged-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-98a1d95b-38fe-499b-ba2c-7e4a80a66353 req-67a0e336-d507-4a64-ab99-9b3d5a3c7c9d service nova] Acquiring lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-98a1d95b-38fe-499b-ba2c-7e4a80a66353 req-67a0e336-d507-4a64-ab99-9b3d5a3c7c9d service nova] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-98a1d95b-38fe-499b-ba2c-7e4a80a66353 req-67a0e336-d507-4a64-ab99-9b3d5a3c7c9d service nova] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-98a1d95b-38fe-499b-ba2c-7e4a80a66353 req-67a0e336-d507-4a64-ab99-9b3d5a3c7c9d service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] No waiting events found dispatching network-vif-plugged-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:26:40 user nova-compute[73254]: WARNING nova.compute.manager [req-98a1d95b-38fe-499b-ba2c-7e4a80a66353 req-67a0e336-d507-4a64-ab99-9b3d5a3c7c9d service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received unexpected event network-vif-plugged-3a5860c4-3ed4-456c-8153-651e38223174 for instance with vm_state building and task_state spawning.
Aug 14 15:26:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026801.905642, fcbc9f15-0f34-43b5-ad97-66c126e81405 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:26:41 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] VM Resumed (Lifecycle Event)
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:26:41 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Instance spawned successfully.
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:26:41 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026801.9068897, fcbc9f15-0f34-43b5-ad97-66c126e81405 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:26:41 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] VM Started (Lifecycle Event)
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:26:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:26:42 user nova-compute[73254]: INFO nova.compute.manager [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 14 15:26:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:26:42 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:26:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-5dd96335-5bc9-4fb8-8ce5-bec40832aca2 req-b75ee31c-6b72-46a3-956a-d304d0e70b0e service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received event network-vif-plugged-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5dd96335-5bc9-4fb8-8ce5-bec40832aca2 req-b75ee31c-6b72-46a3-956a-d304d0e70b0e service nova] Acquiring lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5dd96335-5bc9-4fb8-8ce5-bec40832aca2 req-b75ee31c-6b72-46a3-956a-d304d0e70b0e service nova] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5dd96335-5bc9-4fb8-8ce5-bec40832aca2 req-b75ee31c-6b72-46a3-956a-d304d0e70b0e service nova] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-5dd96335-5bc9-4fb8-8ce5-bec40832aca2 req-b75ee31c-6b72-46a3-956a-d304d0e70b0e service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] No waiting events found dispatching network-vif-plugged-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:26:42 user nova-compute[73254]: WARNING nova.compute.manager [req-5dd96335-5bc9-4fb8-8ce5-bec40832aca2 req-b75ee31c-6b72-46a3-956a-d304d0e70b0e service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received unexpected event network-vif-plugged-3a5860c4-3ed4-456c-8153-651e38223174 for instance with vm_state building and task_state spawning.
Aug 14 15:26:42 user nova-compute[73254]: INFO nova.compute.manager [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Took 6.09 seconds to build instance.
Aug 14 15:26:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5b22eef9-85ff-4608-b3cd-058637fcc855 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.188s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-4387d45f-0395-4292-b73b-7ddc3ac28941 req-1a79f246-da50-4dfb-98e1-76e64bcdf6dd service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-changed-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-4387d45f-0395-4292-b73b-7ddc3ac28941 req-1a79f246-da50-4dfb-98e1-76e64bcdf6dd service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Refreshing instance network info cache due to event network-changed-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4387d45f-0395-4292-b73b-7ddc3ac28941 req-1a79f246-da50-4dfb-98e1-76e64bcdf6dd service nova] Acquiring lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4387d45f-0395-4292-b73b-7ddc3ac28941 req-1a79f246-da50-4dfb-98e1-76e64bcdf6dd service nova] Acquired lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG nova.network.neutron [req-4387d45f-0395-4292-b73b-7ddc3ac28941 req-1a79f246-da50-4dfb-98e1-76e64bcdf6dd service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Refreshing network info cache for port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:48 user nova-compute[73254]: INFO nova.compute.manager [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Terminating instance
Aug 14 15:26:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-044a672b-01b8-418d-b414-87dd9a994b4d req-6f7754cb-f97f-4b64-b34f-6577d18ab141 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-unplugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-044a672b-01b8-418d-b414-87dd9a994b4d req-6f7754cb-f97f-4b64-b34f-6577d18ab141 service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-044a672b-01b8-418d-b414-87dd9a994b4d req-6f7754cb-f97f-4b64-b34f-6577d18ab141 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-044a672b-01b8-418d-b414-87dd9a994b4d req-6f7754cb-f97f-4b64-b34f-6577d18ab141 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-044a672b-01b8-418d-b414-87dd9a994b4d req-6f7754cb-f97f-4b64-b34f-6577d18ab141 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-unplugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:26:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-044a672b-01b8-418d-b414-87dd9a994b4d req-6f7754cb-f97f-4b64-b34f-6577d18ab141 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-unplugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Instance destroyed successfully.
Aug 14 15:26:49 user nova-compute[73254]: DEBUG nova.objects.instance [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lazy-loading 'resources' on Instance uuid 37e5fe23-df6c-48ba-80af-0c2f866a6447 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-14T15:21:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-725449484',display_name='tempest-TestShelveInstance-server-725449484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-725449484',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvXaNMrXK2DDVgAmpRMdqbeyBWUzcoLtZIgZ4qbnePHIM9kJToBP8I+gY4EOJUzyVwXfxUWEy+sUtE0DBYkzEuhvOg0+x/1O7VDtwpMsEmNn8x3yMx4L6e85Fdhklfg6Q==',key_name='tempest-TestShelveInstance-1809884015',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:25:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b77df2a55974cec9ee846a3d2166131',ramdisk_id='',reservation_id='r-ehw0yruh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-500249239',owner_user_name='tempest-TestShelveInstance-500249239-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:25:13Z,user_data=None,user_id='dff145de66554050ade3990af9aba7fa',uuid=37e5fe23-df6c-48ba-80af-0c2f866a6447,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converting VIF {"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_vif [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67f9ad46-1b, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:49 user nova-compute[73254]: INFO os_vif [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:3e:fb,bridge_name='br-int',has_traffic_filtering=True,id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f,network=Network(f3a1395c-a0e8-4d9e-bad9-a30496afa568),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67f9ad46-1b')
Aug 14 15:26:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xTQcKEnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:26:49 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15552ee-91a3-4946-b2bf-0400aaba31c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG nova.network.neutron [req-4387d45f-0395-4292-b73b-7ddc3ac28941 req-1a79f246-da50-4dfb-98e1-76e64bcdf6dd service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updated VIF entry in instance network info cache for port 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG nova.network.neutron [req-4387d45f-0395-4292-b73b-7ddc3ac28941 req-1a79f246-da50-4dfb-98e1-76e64bcdf6dd service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating instance_info_cache with network_info: [{"id": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "address": "fa:16:3e:a6:3e:fb", "network": {"id": "f3a1395c-a0e8-4d9e-bad9-a30496afa568", "bridge": "br-int", "label": "tempest-TestShelveInstance-868211251-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4b77df2a55974cec9ee846a3d2166131", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67f9ad46-1b", "ovs_interfaceid": "67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8852d19c-6d5e-43db-bb3c-e8c11221a3c7]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-4387d45f-0395-4292-b73b-7ddc3ac28941 req-1a79f246-da50-4dfb-98e1-76e64bcdf6dd service nova] Releasing lock "refresh_cache-37e5fe23-df6c-48ba-80af-0c2f866a6447" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:26:49 user nova-compute[73254]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:26:49 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 (non-flash)
Aug 14 15:26:49 user nova-compute[73254]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:26:49 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64847e830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd2929b-04c5-4b7e-a81a-af7e1cd07675]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3730f8c8-7146-42ba-ad46-f1289393061d]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[630e422f-b428-442b-a791-dc04f2ecddaa]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e11b573-5c89-41b0-938d-7d1b65730767]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5baae54b-ec23-4507-9199-276845a1c2f0]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a883e297-b29c-4770-890f-a9d35d9f3109]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260]
Aug 14 15:26:49 user nova-compute[73254]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254, portal: 172.16.0.220,3260] successful.
Aug 14 15:26:49 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d45598e1-71cb-4a83-a537-f45ec99c9254 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.128s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1de711-d14d-4cfd-a523-8bd601e27f0d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.418s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] <== disconnect_volume: return (419ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:26:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Deleting instance files /opt/stack/data/nova/instances/37e5fe23-df6c-48ba-80af-0c2f866a6447_del
Aug 14 15:26:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Deletion of /opt/stack/data/nova/instances/37e5fe23-df6c-48ba-80af-0c2f866a6447_del complete
Aug 14 15:26:49 user nova-compute[73254]: INFO nova.compute.manager [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Took 1.32 seconds to destroy the instance on the hypervisor.
Aug 14 15:26:49 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:26:49 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-e85c1e89-e505-4b78-afd7-5893bd2d900f req-be8f999c-edc3-4a8c-85b6-943835b00ef2 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-deleted-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:50 user nova-compute[73254]: INFO nova.compute.manager [req-e85c1e89-e505-4b78-afd7-5893bd2d900f req-be8f999c-edc3-4a8c-85b6-943835b00ef2 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Neutron deleted interface 67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f; detaching it from the instance and deleting it from the info cache
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.network.neutron [req-e85c1e89-e505-4b78-afd7-5893bd2d900f req-be8f999c-edc3-4a8c-85b6-943835b00ef2 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:26:50 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Took 0.67 seconds to deallocate network for instance.
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-e85c1e89-e505-4b78-afd7-5893bd2d900f req-be8f999c-edc3-4a8c-85b6-943835b00ef2 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Detach interface failed, port_id=67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f, reason: Instance 37e5fe23-df6c-48ba-80af-0c2f866a6447 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:26:50 user nova-compute[73254]: WARNING nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received unexpected event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with vm_state active and task_state deleting.
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:26:50 user nova-compute[73254]: WARNING nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received unexpected event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with vm_state active and task_state deleting.
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:26:50 user nova-compute[73254]: WARNING nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received unexpected event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with vm_state active and task_state deleting.
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-unplugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-unplugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-unplugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Acquiring lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] No waiting events found dispatching network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:26:50 user nova-compute[73254]: WARNING nova.compute.manager [req-5ad99a96-5b30-4415-8418-2bc8f1a7948a req-f84e54d4-c230-4907-b940-ae923bb71d02 service nova] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Received unexpected event network-vif-plugged-67f9ad46-1b4e-4c6c-b04b-cf7e4f36f23f for instance with vm_state active and task_state deleting.
Aug 14 15:26:51 user nova-compute[73254]: INFO nova.compute.manager [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Took 0.84 seconds to detach 1 volumes for instance.
Aug 14 15:26:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Deleting volume: d45598e1-71cb-4a83-a537-f45ec99c9254 {{(pid=73254) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 15:26:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:51 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:26:51 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:26:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:51 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Deleted allocations for instance 37e5fe23-df6c-48ba-80af-0c2f866a6447
Aug 14 15:26:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-efccc07a-bf73-4d09-ac22-bbcb8dd99f4b tempest-TestShelveInstance-500249239 tempest-TestShelveInstance-500249239-project-member] Lock "37e5fe23-df6c-48ba-80af-0c2f866a6447" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.323s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:26:54 user nova-compute[73254]: INFO nova.compute.manager [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attaching volume b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 to /dev/vdb
Aug 14 15:26:54 user nova-compute[73254]: DEBUG os_brick.utils [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2256cd95-d81b-4194-9390-e3447569e2ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05c08bf-8412-4522-ad52-37138b6ced8a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adde88a-2215-40d5-a8ef-0711a5cb7ebc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[279b3486-e482-40d7-8c0d-3fa28b926ea1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:26:54 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:26:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc76866-bf4e-48b2-9ed7-b0bd11845fcd]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG os_brick.utils [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:26:54 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updating existing volume attachment record: ffff5bf2-febf-4183-98bb-416176b60d97 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:26:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:26:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:02 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:27:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUKpkRit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:27:02 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:27:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:27:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:27:02 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:27:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:27:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:27:02 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:27:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c7fa67-8db4-44e1-b6eb-c5f95a7ca0ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:27:03 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4def571-9288-4051-80b0-e8293a3f59e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4] added
Aug 14 15:27:03 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:27:03 user nova-compute[73254]: INFO nova.compute.manager [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Detaching volume 2c8ccb90-0f4a-4999-b3be-c82f1addfa26
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5c1036-3714-46c6-92bc-6b4493c215e8]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[485a4138-9a7c-4b33-8a0e-974011ff6dac]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUKpkRit {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GUKpkRit" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d540294-adcf-40e7-93a0-feafcfb0e3eb]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GUKpkRit'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:03 user nova-compute[73254]: INFO nova.virt.block_device [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Attempting to driver detach volume 2c8ccb90-0f4a-4999-b3be-c82f1addfa26 from mountpoint /dev/vdb
Aug 14 15:27:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Attempting to detach device vdb from instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:27:03 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:27:03 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:27:03 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:27:03 user nova-compute[73254]:   <serial>2c8ccb90-0f4a-4999-b3be-c82f1addfa26</serial>
Aug 14 15:27:03 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 15:27:03 user nova-compute[73254]: </disk>
Aug 14 15:27:03 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e2b6e4-7eaa-4024-8a33-cec6e6fcb624]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully detached device vdb from instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 from the persistent domain config.
Aug 14 15:27:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:27:03 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:27:03 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:27:03 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:27:03 user nova-compute[73254]:   <serial>2c8ccb90-0f4a-4999-b3be-c82f1addfa26</serial>
Aug 14 15:27:03 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 14 15:27:03 user nova-compute[73254]: </disk>
Aug 14 15:27:03 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc4b27b-4eaa-4219-aafb-895360d98014]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:27:03 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:27:03 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1500100f-df42-4fc2-af6f-d4cf2dd5c81b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4, portal: 172.16.0.220,3260]
Aug 14 15:27:03 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4, portal: 172.16.0.220,3260] successful.
Aug 14 15:27:03 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9230c7d2-b752-4843-9b6b-446bfe82962e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[13154fec-5cf3-4d68-85c5-e41b428c2bfe]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:27:03 user nova-compute[73254]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 (non-flash)
Aug 14 15:27:03 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:27:03 user nova-compute[73254]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 (non-flash)
Aug 14 15:27:03 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f207408d-73e5-4494-9b37-f906bc4f8fca]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUKpkRit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026823.53239, e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:27:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully detached device vdb from instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 from the live domain config.
Aug 14 15:27:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NGSnHLMx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:27:03 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:27:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23166383964616338', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166383964616338', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.748s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79c0a71-588e-4602-b4d5-f888eb8b2a5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:27:04 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:27:04 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:27:04 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:27:04 user nova-compute[73254]:   <serial>b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4</serial>
Aug 14 15:27:04 user nova-compute[73254]: </disk>
Aug 14 15:27:04 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7082a7-f062-4285-806e-a1dc730f776a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:27:04 user nova-compute[73254]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 (non-flash)
Aug 14 15:27:04 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 (non-flash)
Aug 14 15:27:04 user nova-compute[73254]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 (non-flash)
Aug 14 15:27:04 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6684ee7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026809.3681026, 37e5fe23-df6c-48ba-80af-0c2f866a6447 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:27:04 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] VM Stopped (Lifecycle Event)
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3097175-da92-4ce1-915d-2a94ae61ce27]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0e3c6165-c17f-4fdc-a58c-2f6ba85d9baf None None] [instance: 37e5fe23-df6c-48ba-80af-0c2f866a6447] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b694f709-ddb5-452c-acf5-b70704aba4cc]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[45732019-1b26-4bc5-a92f-ba9cda833d6b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0abbfb9a-44c2-44f6-9dce-08fe5b1924ec]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f7d529-8ec6-4ab7-8751-f85fecc5a9e9]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[755d2d54-c3da-46a0-afd8-f51cab4f764f]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260]
Aug 14 15:27:04 user nova-compute[73254]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26, portal: 172.16.0.220,3260] successful.
Aug 14 15:27:04 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c8ccb90-0f4a-4999-b3be-c82f1addfa26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee3f7d1-3bde-44e0-9794-71cc73e89835]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== disconnect_volume: return (1076ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No VIF found with MAC fa:16:3e:04:fd:db, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:27:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0cedc6ab-e8c7-41e9-859b-485d37624779 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.675s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:27:05 user nova-compute[73254]: DEBUG nova.objects.instance [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:27:05 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-88db939e-b834-4dcd-a32d-e5a8b873026d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.464s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-625cf800-f92a-4b09-bb2b-1edbfefbaa4f tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-625cf800-f92a-4b09-bb2b-1edbfefbaa4f tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG nova.compute.manager [None req-625cf800-f92a-4b09-bb2b-1edbfefbaa4f tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG nova.compute.manager [None req-625cf800-f92a-4b09-bb2b-1edbfefbaa4f tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73254) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG nova.objects.instance [None req-625cf800-f92a-4b09-bb2b-1edbfefbaa4f tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:27:06 user nova-compute[73254]: INFO nova.compute.manager [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Detaching volume b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4
Aug 14 15:27:06 user nova-compute[73254]: INFO nova.virt.block_device [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attempting to driver detach volume b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 from mountpoint /dev/vdb
Aug 14 15:27:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Attempting to detach device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:27:06 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:27:06 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:27:06 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:27:06 user nova-compute[73254]:   <serial>b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4</serial>
Aug 14 15:27:06 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:27:06 user nova-compute[73254]: </disk>
Aug 14 15:27:06 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:27:06 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Successfully detached device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the persistent domain config.
Aug 14 15:27:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:27:06 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:27:06 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:27:06 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:27:06 user nova-compute[73254]:   <serial>b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4</serial>
Aug 14 15:27:06 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:27:06 user nova-compute[73254]: </disk>
Aug 14 15:27:06 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-c4b34555-7df3-4b33-b762-d20cab9ba18e req-aa76a590-449e-400e-822c-3bc0f2838563 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c4b34555-7df3-4b33-b762-d20cab9ba18e req-aa76a590-449e-400e-822c-3bc0f2838563 service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c4b34555-7df3-4b33-b762-d20cab9ba18e req-aa76a590-449e-400e-822c-3bc0f2838563 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c4b34555-7df3-4b33-b762-d20cab9ba18e req-aa76a590-449e-400e-822c-3bc0f2838563 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:27:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-c4b34555-7df3-4b33-b762-d20cab9ba18e req-aa76a590-449e-400e-822c-3bc0f2838563 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:27:06 user nova-compute[73254]: WARNING nova.compute.manager [req-c4b34555-7df3-4b33-b762-d20cab9ba18e req-aa76a590-449e-400e-822c-3bc0f2838563 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state active and task_state powering-off.
Aug 14 15:27:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026827.512617, 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:27:07 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Successfully detached device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the live domain config.
Aug 14 15:27:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GUKpkRit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:27:07 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:07 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance destroyed successfully.
Aug 14 15:27:07 user nova-compute[73254]: DEBUG nova.compute.manager [None req-625cf800-f92a-4b09-bb2b-1edbfefbaa4f tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe0ca17-cd4c-478f-9c08-d79ae2295a3a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d749c1a8-d4e7-40e8-812e-4f8b94ad9716]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 (non-flash)
Aug 14 15:27:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 (non-flash)
Aug 14 15:27:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd668653490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-625cf800-f92a-4b09-bb2b-1edbfefbaa4f tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.139s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[81230ab2-2287-43aa-98a5-7407d41168f3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca410e-d551-4e40-bd26-d3d1ebb680a2]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f39746-a59f-4f09-bdad-0558e594d9d4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42bf8c3-06bd-4d37-8e21-d1a1fa36c090]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cca61b-89e5-48ce-b657-c6b50535e2fc]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6717f348-da99-4a79-897a-2efa0cad0c3e]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4, portal: 172.16.0.220,3260]
Aug 14 15:27:07 user nova-compute[73254]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4, portal: 172.16.0.220,3260] successful.
Aug 14 15:27:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b22d11a4-b1b8-4bc2-a293-e3c31bd03ce4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c719b91-674c-426e-b6f8-28fe7c9f18a2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== disconnect_volume: return (290ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:27:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:27:08 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:27:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6fbcde40-42de-4eec-b7c9-9310be92401e tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.886s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:27:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-b95d48ae-a50c-4c5e-8424-96d8e30f6033 req-730e5dea-6ba3-4138-b6d9-8333ca7c9870 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:27:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b95d48ae-a50c-4c5e-8424-96d8e30f6033 req-730e5dea-6ba3-4138-b6d9-8333ca7c9870 service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:27:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b95d48ae-a50c-4c5e-8424-96d8e30f6033 req-730e5dea-6ba3-4138-b6d9-8333ca7c9870 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:27:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b95d48ae-a50c-4c5e-8424-96d8e30f6033 req-730e5dea-6ba3-4138-b6d9-8333ca7c9870 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:27:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-b95d48ae-a50c-4c5e-8424-96d8e30f6033 req-730e5dea-6ba3-4138-b6d9-8333ca7c9870 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:27:08 user nova-compute[73254]: WARNING nova.compute.manager [req-b95d48ae-a50c-4c5e-8424-96d8e30f6033 req-730e5dea-6ba3-4138-b6d9-8333ca7c9870 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state stopped and task_state None.
Aug 14 15:27:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:27:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:27:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:27:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:27:16 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:27:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:27:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:27:18 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:27:18 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:27:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8420MB free_disk=25.139820098876953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance fcbc9f15-0f34-43b5-ad97-66c126e81405 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:27:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:27:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:27:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:27:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:27:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:27:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:27:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:27:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:27:21 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:27:21 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:27:22 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updating instance_info_cache with network_info: [{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:27:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:27:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:27:22 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026827.527687, e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:27:22 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] VM Stopped (Lifecycle Event)
Aug 14 15:27:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-45360890-1e1e-47d4-9fd9-66f16c5c7a8b None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:27:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-45360890-1e1e-47d4-9fd9-66f16c5c7a8b None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:27:23 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:27:23 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:27:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:27:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:27:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:27:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:27:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:27:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:27:28 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:27:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:29 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:27:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:27:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:27:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:27:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:27:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:27:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:27:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:27:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:27:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:27:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:28:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:28:00 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:28:01 user nova-compute[73254]: INFO nova.compute.manager [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attaching volume e06e8816-545a-42b2-8f3d-e1b14ca5f6fe to /dev/vdb
Aug 14 15:28:01 user nova-compute[73254]: DEBUG os_brick.utils [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a08fa9-769b-4256-812c-f03a3232519e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c20936-f3df-44aa-acb8-65ce096bd27a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ba8dc6-267b-4ebd-89a9-02ca13e6be1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4934f1e8-c5ac-42b1-88a0-9541d5bbae2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:28:01 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:28:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a183bd-a8ec-4c96-a769-ce1908794e35]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG os_brick.utils [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:28:01 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updating existing volume attachment record: d18a1cfd-a645-406a-b1bd-8072c728953a {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:28:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWCYOmJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:28:09 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:28:09 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:28:09 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[07305851-7f50-433a-b29e-492fe0e67dcb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:28:09 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d0e799-8bec-4a6e-ab30-7c4a873dbadf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe] added
Aug 14 15:28:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[79191b3c-1187-4d11-920e-13f2aa4352a6]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0928a28-19cc-4162-90ce-2b5c8e9f2399]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DWCYOmJg {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DWCYOmJg" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd1bf08-046e-482a-af73-55f5a1ca4b80]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DWCYOmJg'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb0122f-f3c8-4d8b-908b-860d73aed033]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ede061-ee9d-4785-94e2-8b354c9b6d03]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:28:09 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:28:09 user nova-compute[73254]:  {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:28:09 user nova-compute[73254]: WARNING os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 15:28:09 user nova-compute[73254]: 
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[509f5afc-c12e-408b-95b2-6378dca62f83]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe, portal: 172.16.0.220,3260]
Aug 14 15:28:09 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe, portal: 172.16.0.220,3260] successful.
Aug 14 15:28:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[56435206-9338-4e52-a60e-32569a00dbaa]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13310f5-3137-42a0-993f-60b48d5b4b52]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe (non-flash)
Aug 14 15:28:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe (non-flash)
Aug 14 15:28:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:28:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:10 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:10 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48f40ae-33df-404e-b5a8-6cfcbc01a6a6]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:10 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:28:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWCYOmJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:28:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:28:11 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== connect_volume: return (1271ms) {'type': 'block', 'scsi_wwn': '23837396630393434', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:28:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837396630393434', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:28:11 user nova-compute[73254]: DEBUG nova.objects.instance [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:28:11 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:28:11 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:28:11 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:28:11 user nova-compute[73254]:   <serial>e06e8816-545a-42b2-8f3d-e1b14ca5f6fe</serial>
Aug 14 15:28:11 user nova-compute[73254]: </disk>
Aug 14 15:28:11 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:28:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:28:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:28:11 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] No VIF found with MAC fa:16:3e:04:fd:db, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:28:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-4b7ce5cc-3d64-4762-9a77-22316f351762 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.522s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:28:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:28:13 user nova-compute[73254]: INFO nova.compute.manager [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Detaching volume e06e8816-545a-42b2-8f3d-e1b14ca5f6fe
Aug 14 15:28:13 user nova-compute[73254]: INFO nova.virt.block_device [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Attempting to driver detach volume e06e8816-545a-42b2-8f3d-e1b14ca5f6fe from mountpoint /dev/vdb
Aug 14 15:28:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Attempting to detach device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:28:13 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:28:13 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:28:13 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:28:13 user nova-compute[73254]:   <serial>e06e8816-545a-42b2-8f3d-e1b14ca5f6fe</serial>
Aug 14 15:28:13 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:28:13 user nova-compute[73254]: </disk>
Aug 14 15:28:13 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:28:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Successfully detached device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the persistent domain config.
Aug 14 15:28:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:28:13 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:28:13 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:28:13 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:28:13 user nova-compute[73254]:   <serial>e06e8816-545a-42b2-8f3d-e1b14ca5f6fe</serial>
Aug 14 15:28:13 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:28:13 user nova-compute[73254]: </disk>
Aug 14 15:28:13 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026893.9549692, 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:28:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Successfully detached device vdb from instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 from the live domain config.
Aug 14 15:28:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DWCYOmJg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:28:13 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:28:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[003df21a-ae4e-4279-a5b7-3f8f4eca1023]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:13 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d2bb84-01fe-4d63-8e4a-0872efa3e7a1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe (non-flash)
Aug 14 15:28:14 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe (non-flash)
Aug 14 15:28:14 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd693fda680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e93610b-8669-4e8a-bfd2-a81b2b1bb529]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8b24ca-1cc5-4a60-bca1-e49ac2763850]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0deb84a-7e45-4c42-bdfb-7cdbd0b3d8e6]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7344fd6a-9829-4f48-9fed-bd6ca9b0b15f]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25df40e-d7c7-47c6-81e7-393aa2f44f71]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1976089-cd65-4b40-96ca-171400d32370]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe, portal: 172.16.0.220,3260]
Aug 14 15:28:14 user nova-compute[73254]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe, portal: 172.16.0.220,3260] successful.
Aug 14 15:28:14 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e06e8816-545a-42b2-8f3d-e1b14ca5f6fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42afb6f-fe10-4eb3-8f12-8a017c5b6807]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] <== disconnect_volume: return (255ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG nova.objects.instance [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'flavor' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:14 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-b81c1cea-79b0-4afd-918c-9d707da52584 tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.616s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:28:16 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:28:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:28:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:28:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:28:16 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:28:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:18 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:28:18 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:28:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8540MB free_disk=25.137248992919922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance fcbc9f15-0f34-43b5-ad97-66c126e81405 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:28:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:28:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:28:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:28:22 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:28:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:28:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:28:22 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:28:23 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updating instance_info_cache with network_info: [{"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:28:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:28:23 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:28:23 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:28:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:28:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:28:25 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:28:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:28:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-af89dfcf-7c19-4fb5-a84d-ee411748d5c7 req-7310d04f-4dc8-4424-a55d-b69fd6bf66f9 service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received event network-changed-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:28:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-af89dfcf-7c19-4fb5-a84d-ee411748d5c7 req-7310d04f-4dc8-4424-a55d-b69fd6bf66f9 service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Refreshing instance network info cache due to event network-changed-3a5860c4-3ed4-456c-8153-651e38223174. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:28:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-af89dfcf-7c19-4fb5-a84d-ee411748d5c7 req-7310d04f-4dc8-4424-a55d-b69fd6bf66f9 service nova] Acquiring lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:28:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-af89dfcf-7c19-4fb5-a84d-ee411748d5c7 req-7310d04f-4dc8-4424-a55d-b69fd6bf66f9 service nova] Acquired lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:28:27 user nova-compute[73254]: DEBUG nova.network.neutron [req-af89dfcf-7c19-4fb5-a84d-ee411748d5c7 req-7310d04f-4dc8-4424-a55d-b69fd6bf66f9 service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Refreshing network info cache for port 3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:28:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:27 user nova-compute[73254]: DEBUG nova.network.neutron [req-af89dfcf-7c19-4fb5-a84d-ee411748d5c7 req-7310d04f-4dc8-4424-a55d-b69fd6bf66f9 service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Updated VIF entry in instance network info cache for port 3a5860c4-3ed4-456c-8153-651e38223174. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:28:27 user nova-compute[73254]: DEBUG nova.network.neutron [req-af89dfcf-7c19-4fb5-a84d-ee411748d5c7 req-7310d04f-4dc8-4424-a55d-b69fd6bf66f9 service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Updating instance_info_cache with network_info: [{"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:28:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-af89dfcf-7c19-4fb5-a84d-ee411748d5c7 req-7310d04f-4dc8-4424-a55d-b69fd6bf66f9 service nova] Releasing lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:28:28 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:28:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:29 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:28:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:28:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lazy-loading 'flavor' on Instance uuid fcbc9f15-0f34-43b5-ad97-66c126e81405 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:28:31 user nova-compute[73254]: INFO nova.compute.manager [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Attaching volume c6bc108c-c225-44c5-b415-f362ff232457 to /dev/vdb
Aug 14 15:28:31 user nova-compute[73254]: DEBUG os_brick.utils [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9978e5-0a78-4cee-a65a-9e2b936a2cb2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d566d4-d696-4fab-bc80-5490bb633afa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e31cd-ccbf-455d-bc0b-14de31c95db1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeff15c-4848-430c-af3f-b6d630ee51b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:28:31 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:28:31 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c6d60-0de3-48dc-b71b-df23a0349365]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG os_brick.utils [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:28:31 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Updating existing volume attachment record: 4e192b4f-ace0-4faf-9f7e-0e87cb25f544 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:28:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KWxrgEym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:28:46 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:28:46 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:28:46 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[773cb646-9770-4502-9e6c-45bc48799649]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:28:46 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[243f1423-74d4-43a4-ad0a-2dd996798bf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457] added
Aug 14 15:28:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[60436c05-3f7a-4d0b-ae2f-65ae9e97b708]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca40c73e-b91c-4028-92d1-d16005d13818]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KWxrgEym {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KWxrgEym" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[35827e54-c0e3-4158-a77c-8c9e50336180]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KWxrgEym'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e62e003-4730-4d52-9531-386c5b885ed9]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8ec385-e62b-4287-a882-52fe257140ff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:28:46 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:28:46 user nova-compute[73254]:  {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:28:46 user nova-compute[73254]: WARNING os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 15:28:46 user nova-compute[73254]: 
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b703a6-d270-4d0c-be05-1c14ecbe4756]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457, portal: 172.16.0.220,3260]
Aug 14 15:28:46 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457, portal: 172.16.0.220,3260] successful.
Aug 14 15:28:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed176fb0-e538-4f51-baa5-a235d6f58774]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06bd1b7-f9ab-4e87-a9e9-4e4c4dcfc2e0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 (non-flash)
Aug 14 15:28:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 (non-flash)
Aug 14 15:28:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[717f9fcb-07b0-4f66-8e97-8e36994eb6fc]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:28:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KWxrgEym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:28:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:28:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23437323631613035', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:28:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437323631613035', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:28:47 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lazy-loading 'flavor' on Instance uuid fcbc9f15-0f34-43b5-ad97-66c126e81405 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:28:47 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:28:47 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:28:47 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:28:47 user nova-compute[73254]:   <serial>c6bc108c-c225-44c5-b415-f362ff232457</serial>
Aug 14 15:28:47 user nova-compute[73254]: </disk>
Aug 14 15:28:47 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:28:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:28:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:28:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] No VIF found with MAC fa:16:3e:73:cc:95, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:28:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5fa24a8a-812b-4ccc-b5a1-0a51bc31d67a tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.660s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:28:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:28:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:28:49 user nova-compute[73254]: INFO nova.compute.manager [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Detaching volume c6bc108c-c225-44c5-b415-f362ff232457
Aug 14 15:28:49 user nova-compute[73254]: INFO nova.virt.block_device [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Attempting to driver detach volume c6bc108c-c225-44c5-b415-f362ff232457 from mountpoint /dev/vdb
Aug 14 15:28:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Attempting to detach device vdb from instance fcbc9f15-0f34-43b5-ad97-66c126e81405 from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:28:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:28:49 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:28:49 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:28:49 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:28:49 user nova-compute[73254]:   <serial>c6bc108c-c225-44c5-b415-f362ff232457</serial>
Aug 14 15:28:49 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:28:49 user nova-compute[73254]: </disk>
Aug 14 15:28:49 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:28:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Successfully detached device vdb from instance fcbc9f15-0f34-43b5-ad97-66c126e81405 from the persistent domain config.
Aug 14 15:28:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fcbc9f15-0f34-43b5-ad97-66c126e81405 from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:28:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:28:49 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:28:49 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:28:49 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:28:49 user nova-compute[73254]:   <serial>c6bc108c-c225-44c5-b415-f362ff232457</serial>
Aug 14 15:28:49 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:28:49 user nova-compute[73254]: </disk>
Aug 14 15:28:49 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692026930.148679, fcbc9f15-0f34-43b5-ad97-66c126e81405 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fcbc9f15-0f34-43b5-ad97-66c126e81405 {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:28:50 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Successfully detached device vdb from instance fcbc9f15-0f34-43b5-ad97-66c126e81405 from the live domain config.
Aug 14 15:28:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KWxrgEym', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:28:50 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7146e23-a760-406f-8ef5-8134a2ee32e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a398db5a-385a-4dd8-88a1-8d54ab1c3f25]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 (non-flash)
Aug 14 15:28:50 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 (non-flash)
Aug 14 15:28:50 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd694b083a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0c4709-a134-40d8-8df9-2a04bd352c0b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c54e20-3ad9-4b98-8418-f4ab8ac56436]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58faf0b-5ef0-4cb0-9006-c45ca8e56c7d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a710cf9a-10e4-4289-8a40-2a6d0a126525]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc1c300-5a25-4e4e-bc8a-d1054c391067]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf305cf-3526-47ee-a970-76be1a72739b]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457, portal: 172.16.0.220,3260]
Aug 14 15:28:50 user nova-compute[73254]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457, portal: 172.16.0.220,3260] successful.
Aug 14 15:28:50 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6bc108c-c225-44c5-b415-f362ff232457 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef051f51-33b6-4ff2-8715-5498f755d18d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] <== disconnect_volume: return (268ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:28:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:28:51 user nova-compute[73254]: DEBUG nova.objects.instance [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lazy-loading 'flavor' on Instance uuid fcbc9f15-0f34-43b5-ad97-66c126e81405 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-2e1c888f-743b-45ba-b0b3-9ee7a31b0678 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.727s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:28:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:28:57 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:28:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquired lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:28:57 user nova-compute[73254]: DEBUG nova.network.neutron [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:28:57 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'info_cache' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.network.neutron [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updating instance_info_cache with network_info: [{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Releasing lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:28:58 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance destroyed successfully.
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'resources' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-16733886',display_name='tempest-AttachVolumeTestJSON-server-16733886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-16733886',id=41,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxEAZaymEwwljUUm0bIND6+g7UStk6ayOY0oDvHBPzJ7vBCL0k+kKVFgHuWCAyGaHw+gdORl3+kdPOLWn88b3xmGLjBfM0KROLhtVxvGAVzsR9I/6NAtKreWeWvrEUlw==',key_name='tempest-keypair-1829711365',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-kumsk06a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=e94cdb72-c3cd-4d1f-a50f-934c2d9218f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG os_vif [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e972792-34, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:28:58 user nova-compute[73254]: INFO os_vif [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34')
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Start _get_guest_xml network_info=[{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'numa_topology' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:58 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:28:58 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'vcpu_model' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-16733886',display_name='tempest-AttachVolumeTestJSON-server-16733886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-16733886',id=41,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxEAZaymEwwljUUm0bIND6+g7UStk6ayOY0oDvHBPzJ7vBCL0k+kKVFgHuWCAyGaHw+gdORl3+kdPOLWn88b3xmGLjBfM0KROLhtVxvGAVzsR9I/6NAtKreWeWvrEUlw==',key_name='tempest-keypair-1829711365',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-kumsk06a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=e94cdb72-c3cd-4d1f-a50f-934c2d9218f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'pci_devices' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:28:58 user nova-compute[73254]:   <uuid>e94cdb72-c3cd-4d1f-a50f-934c2d9218f1</uuid>
Aug 14 15:28:58 user nova-compute[73254]:   <name>instance-00000029</name>
Aug 14 15:28:58 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:28:58 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:28:58 user nova-compute[73254]:   <metadata>
Aug 14 15:28:58 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:28:58 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:28:58 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeTestJSON-server-16733886</nova:name>
Aug 14 15:28:58 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:28:58</nova:creationTime>
Aug 14 15:28:58 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:28:58 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:28:58 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:28:58 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:28:58 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:28:58 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:28:58 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:28:58 user nova-compute[73254]:       <nova:owner>
Aug 14 15:28:58 user nova-compute[73254]:         <nova:user uuid="4518a054567744089ed8477a58377821">tempest-AttachVolumeTestJSON-395337043-project-member</nova:user>
Aug 14 15:28:58 user nova-compute[73254]:         <nova:project uuid="05958df454f94ce5acc81cf06b929d27">tempest-AttachVolumeTestJSON-395337043</nova:project>
Aug 14 15:28:58 user nova-compute[73254]:       </nova:owner>
Aug 14 15:28:58 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:28:58 user nova-compute[73254]:       <nova:ports>
Aug 14 15:28:58 user nova-compute[73254]:         <nova:port uuid="8e972792-3462-4547-84e7-bc0b50c37b06">
Aug 14 15:28:58 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 15:28:58 user nova-compute[73254]:         </nova:port>
Aug 14 15:28:58 user nova-compute[73254]:       </nova:ports>
Aug 14 15:28:58 user nova-compute[73254]:     </nova:instance>
Aug 14 15:28:58 user nova-compute[73254]:   </metadata>
Aug 14 15:28:58 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:28:58 user nova-compute[73254]:     <system>
Aug 14 15:28:58 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:28:58 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:28:58 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:28:58 user nova-compute[73254]:       <entry name="serial">e94cdb72-c3cd-4d1f-a50f-934c2d9218f1</entry>
Aug 14 15:28:58 user nova-compute[73254]:       <entry name="uuid">e94cdb72-c3cd-4d1f-a50f-934c2d9218f1</entry>
Aug 14 15:28:58 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:28:58 user nova-compute[73254]:     </system>
Aug 14 15:28:58 user nova-compute[73254]:   </sysinfo>
Aug 14 15:28:58 user nova-compute[73254]:   <os>
Aug 14 15:28:58 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:28:58 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:28:58 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:28:58 user nova-compute[73254]:   </os>
Aug 14 15:28:58 user nova-compute[73254]:   <features>
Aug 14 15:28:58 user nova-compute[73254]:     <acpi/>
Aug 14 15:28:58 user nova-compute[73254]:     <apic/>
Aug 14 15:28:58 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:28:58 user nova-compute[73254]:   </features>
Aug 14 15:28:58 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:28:58 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:28:58 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:28:58 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:28:58 user nova-compute[73254]:   </clock>
Aug 14 15:28:58 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:28:58 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:28:58 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:28:58 user nova-compute[73254]:   </cpu>
Aug 14 15:28:58 user nova-compute[73254]:   <devices>
Aug 14 15:28:58 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:28:58 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:28:58 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk"/>
Aug 14 15:28:58 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:28:58 user nova-compute[73254]:     </disk>
Aug 14 15:28:58 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:28:58 user nova-compute[73254]:       <mac address="fa:16:3e:5b:40:78"/>
Aug 14 15:28:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:28:58 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:28:58 user nova-compute[73254]:       <target dev="tap8e972792-34"/>
Aug 14 15:28:58 user nova-compute[73254]:     </interface>
Aug 14 15:28:58 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:28:58 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/console.log" append="off"/>
Aug 14 15:28:58 user nova-compute[73254]:     </serial>
Aug 14 15:28:58 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:28:58 user nova-compute[73254]:     <video>
Aug 14 15:28:58 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:28:58 user nova-compute[73254]:     </video>
Aug 14 15:28:58 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:28:58 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:28:58 user nova-compute[73254]:     </rng>
Aug 14 15:28:58 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:28:58 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:28:58 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:28:58 user nova-compute[73254]:     </memballoon>
Aug 14 15:28:58 user nova-compute[73254]:   </devices>
Aug 14 15:28:58 user nova-compute[73254]: </domain>
Aug 14 15:28:58 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'trusted_certs' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.185s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Cannot resize image /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'migration_context' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-16733886',display_name='tempest-AttachVolumeTestJSON-server-16733886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-16733886',id=41,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxEAZaymEwwljUUm0bIND6+g7UStk6ayOY0oDvHBPzJ7vBCL0k+kKVFgHuWCAyGaHw+gdORl3+kdPOLWn88b3xmGLjBfM0KROLhtVxvGAVzsR9I/6NAtKreWeWvrEUlw==',key_name='tempest-keypair-1829711365',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-kumsk06a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:27:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=e94cdb72-c3cd-4d1f-a50f-934c2d9218f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG os_vif [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e972792-34, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e972792-34, col_values=(('external_ids', {'iface-id': '8e972792-3462-4547-84e7-bc0b50c37b06', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:40:78', 'vm-uuid': 'e94cdb72-c3cd-4d1f-a50f-934c2d9218f1'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:28:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:28:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:28:59 user nova-compute[73254]: INFO os_vif [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34')
Aug 14 15:29:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-917a7586-7379-40cd-b39c-b5ae0b6ef05d req-e4cadcec-c800-44fb-a188-2c5a6da7e774 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:29:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-917a7586-7379-40cd-b39c-b5ae0b6ef05d req-e4cadcec-c800-44fb-a188-2c5a6da7e774 service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-917a7586-7379-40cd-b39c-b5ae0b6ef05d req-e4cadcec-c800-44fb-a188-2c5a6da7e774 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-917a7586-7379-40cd-b39c-b5ae0b6ef05d req-e4cadcec-c800-44fb-a188-2c5a6da7e774 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:00 user nova-compute[73254]: DEBUG nova.compute.manager [req-917a7586-7379-40cd-b39c-b5ae0b6ef05d req-e4cadcec-c800-44fb-a188-2c5a6da7e774 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:29:00 user nova-compute[73254]: WARNING nova.compute.manager [req-917a7586-7379-40cd-b39c-b5ae0b6ef05d req-e4cadcec-c800-44fb-a188-2c5a6da7e774 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state stopped and task_state powering-on.
Aug 14 15:29:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:02 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026942.6563628, e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:29:02 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] VM Resumed (Lifecycle Event)
Aug 14 15:29:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-910b54c4-c541-47ad-9987-f8a1530d621d req-cecec699-a7ae-4811-8e24-77f95edbe6c1 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:29:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-910b54c4-c541-47ad-9987-f8a1530d621d req-cecec699-a7ae-4811-8e24-77f95edbe6c1 service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-910b54c4-c541-47ad-9987-f8a1530d621d req-cecec699-a7ae-4811-8e24-77f95edbe6c1 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:02 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-910b54c4-c541-47ad-9987-f8a1530d621d req-cecec699-a7ae-4811-8e24-77f95edbe6c1 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:02 user nova-compute[73254]: DEBUG nova.compute.manager [req-910b54c4-c541-47ad-9987-f8a1530d621d req-cecec699-a7ae-4811-8e24-77f95edbe6c1 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:29:02 user nova-compute[73254]: WARNING nova.compute.manager [req-910b54c4-c541-47ad-9987-f8a1530d621d req-cecec699-a7ae-4811-8e24-77f95edbe6c1 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state stopped and task_state powering-on.
Aug 14 15:29:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:29:02 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance rebooted successfully.
Aug 14 15:29:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-7b0d508f-a069-4f53-99bd-44781410a841 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:29:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:29:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:29:02 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 14 15:29:02 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692026942.6580548, e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:29:02 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] VM Started (Lifecycle Event)
Aug 14 15:29:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:29:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:29:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:10 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:10 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:29:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:17 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:17 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:29:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:29:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:29:17 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:29:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:29:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:29:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:29:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:29:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:29:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:29:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:29:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:29:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:19 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:29:19 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:29:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8364MB free_disk=25.133960723876953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance fcbc9f15-0f34-43b5-ad97-66c126e81405 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:29:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.420s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:23 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:24 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:29:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:29:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:29:24 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:29:25 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Updating instance_info_cache with network_info: [{"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:29:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-fcbc9f15-0f34-43b5-ad97-66c126e81405" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:29:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:29:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:29:28 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:35 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:29:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:29:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:29:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:46 user nova-compute[73254]: INFO nova.compute.manager [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Terminating instance
Aug 14 15:29:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-de3f005b-7c1a-4d77-98bb-97fbeff9f348 req-df9d8e96-359c-4afb-914c-9ca249858dd2 service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received event network-vif-unplugged-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-de3f005b-7c1a-4d77-98bb-97fbeff9f348 req-df9d8e96-359c-4afb-914c-9ca249858dd2 service nova] Acquiring lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-de3f005b-7c1a-4d77-98bb-97fbeff9f348 req-df9d8e96-359c-4afb-914c-9ca249858dd2 service nova] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-de3f005b-7c1a-4d77-98bb-97fbeff9f348 req-df9d8e96-359c-4afb-914c-9ca249858dd2 service nova] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-de3f005b-7c1a-4d77-98bb-97fbeff9f348 req-df9d8e96-359c-4afb-914c-9ca249858dd2 service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] No waiting events found dispatching network-vif-unplugged-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:29:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-de3f005b-7c1a-4d77-98bb-97fbeff9f348 req-df9d8e96-359c-4afb-914c-9ca249858dd2 service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received event network-vif-unplugged-3a5860c4-3ed4-456c-8153-651e38223174 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:29:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Instance destroyed successfully.
Aug 14 15:29:47 user nova-compute[73254]: DEBUG nova.objects.instance [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lazy-loading 'resources' on Instance uuid fcbc9f15-0f34-43b5-ad97-66c126e81405 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:29:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:26:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-289094552',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-289094552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2890945',id=43,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNhBamXk4if668C496OvO0pB90mC74AWv4bCb9skWqN12nuvAdmEQMI1vr2mdC3xOSrm1cdllxIXJRwScMlyN9kwXjw+HD5rlUxzBTwvKINmFSddbBhRh2Z7lnrIa65GIQ==',key_name='tempest-keypair-1704929400',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:26:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9c518b42c3374a189e3cb99cd31d2d02',ramdisk_id='',reservation_id='r-3e2i70qw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1925171100',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:26:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='042cc963edc04bfdb686a5dbc46b6be9',uuid=fcbc9f15-0f34-43b5-ad97-66c126e81405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:29:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Converting VIF {"id": "3a5860c4-3ed4-456c-8153-651e38223174", "address": "fa:16:3e:73:cc:95", "network": {"id": "6f824e0b-5d92-4a6f-8348-451d28fd7c2b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2080394513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9c518b42c3374a189e3cb99cd31d2d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5860c4-3e", "ovs_interfaceid": "3a5860c4-3ed4-456c-8153-651e38223174", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:29:47 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5860c4-3ed4-456c-8153-651e38223174,network=Network(6f824e0b-5d92-4a6f-8348-451d28fd7c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5860c4-3e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:29:47 user nova-compute[73254]: DEBUG os_vif [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5860c4-3ed4-456c-8153-651e38223174,network=Network(6f824e0b-5d92-4a6f-8348-451d28fd7c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5860c4-3e') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:29:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a5860c4-3e, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:29:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:29:47 user nova-compute[73254]: INFO os_vif [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:cc:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5860c4-3ed4-456c-8153-651e38223174,network=Network(6f824e0b-5d92-4a6f-8348-451d28fd7c2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5860c4-3e')
Aug 14 15:29:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Deleting instance files /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405_del
Aug 14 15:29:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Deletion of /opt/stack/data/nova/instances/fcbc9f15-0f34-43b5-ad97-66c126e81405_del complete
Aug 14 15:29:47 user nova-compute[73254]: INFO nova.compute.manager [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 15:29:47 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:29:47 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:29:47 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:29:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-f39211ce-569d-4594-9390-3ba0302176af req-e9c96bca-0350-4056-aa20-74bed4d0bebb service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received event network-vif-plugged-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:29:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f39211ce-569d-4594-9390-3ba0302176af req-e9c96bca-0350-4056-aa20-74bed4d0bebb service nova] Acquiring lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f39211ce-569d-4594-9390-3ba0302176af req-e9c96bca-0350-4056-aa20-74bed4d0bebb service nova] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-f39211ce-569d-4594-9390-3ba0302176af req-e9c96bca-0350-4056-aa20-74bed4d0bebb service nova] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-f39211ce-569d-4594-9390-3ba0302176af req-e9c96bca-0350-4056-aa20-74bed4d0bebb service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] No waiting events found dispatching network-vif-plugged-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:29:48 user nova-compute[73254]: WARNING nova.compute.manager [req-f39211ce-569d-4594-9390-3ba0302176af req-e9c96bca-0350-4056-aa20-74bed4d0bebb service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received unexpected event network-vif-plugged-3a5860c4-3ed4-456c-8153-651e38223174 for instance with vm_state active and task_state deleting.
Aug 14 15:29:48 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:29:48 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Took 1.60 seconds to deallocate network for instance.
Aug 14 15:29:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:49 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:29:49 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:29:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:49 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Deleted allocations for instance fcbc9f15-0f34-43b5-ad97-66c126e81405
Aug 14 15:29:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-c7a988d9-d9c2-4e0e-9206-44623cfe8e96 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100 tempest-TestServerVolumeAttachScenarioOldVersion-1925171100-project-member] Lock "fcbc9f15-0f34-43b5-ad97-66c126e81405" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.822s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:49 user nova-compute[73254]: INFO nova.compute.manager [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Terminating instance
Aug 14 15:29:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-457078a0-13ca-4a2e-aeda-6cfed682efa2 req-c8a464eb-b6b1-402e-965b-c310e5c6ef31 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received event network-vif-unplugged-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-457078a0-13ca-4a2e-aeda-6cfed682efa2 req-c8a464eb-b6b1-402e-965b-c310e5c6ef31 service nova] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-457078a0-13ca-4a2e-aeda-6cfed682efa2 req-c8a464eb-b6b1-402e-965b-c310e5c6ef31 service nova] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-457078a0-13ca-4a2e-aeda-6cfed682efa2 req-c8a464eb-b6b1-402e-965b-c310e5c6ef31 service nova] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-457078a0-13ca-4a2e-aeda-6cfed682efa2 req-c8a464eb-b6b1-402e-965b-c310e5c6ef31 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] No waiting events found dispatching network-vif-unplugged-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-457078a0-13ca-4a2e-aeda-6cfed682efa2 req-c8a464eb-b6b1-402e-965b-c310e5c6ef31 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received event network-vif-unplugged-26624a33-e8c3-413f-944e-29a2b11e8d1b for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:29:50 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Instance destroyed successfully.
Aug 14 15:29:50 user nova-compute[73254]: DEBUG nova.objects.instance [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lazy-loading 'resources' on Instance uuid 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:22:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-602660682',display_name='tempest-SnapshotDataIntegrityTests-server-602660682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-602660682',id=42,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEtkZqy4VPGT7GQhtCJNXPuCo3E14ZVVXQrjznYR7P9Yu7+oXIkJCZdo5XDa/eLxGAoKL5fxn1ZcGXz1copzLQDF/K8UHF35ViaJhBuuQQYITtYh5IomAsLFMNmyRaEvqw==',key_name='tempest-keypair-782124385',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:22:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59c792b3951946b6b51a89e39a871e3e',ramdisk_id='',reservation_id='r-zsg34299',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-159888697',owner_user_name='tempest-SnapshotDataIntegrityTests-159888697-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:22:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b639f723cee84d449ba64978be430ff0',uuid=97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Converting VIF {"id": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "address": "fa:16:3e:04:fd:db", "network": {"id": "72c76653-cd29-4269-94c3-b374c77016e1", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1809300685-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.65", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59c792b3951946b6b51a89e39a871e3e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26624a33-e8", "ovs_interfaceid": "26624a33-e8c3-413f-944e-29a2b11e8d1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:04:fd:db,bridge_name='br-int',has_traffic_filtering=True,id=26624a33-e8c3-413f-944e-29a2b11e8d1b,network=Network(72c76653-cd29-4269-94c3-b374c77016e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26624a33-e8') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG os_vif [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:fd:db,bridge_name='br-int',has_traffic_filtering=True,id=26624a33-e8c3-413f-944e-29a2b11e8d1b,network=Network(72c76653-cd29-4269-94c3-b374c77016e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26624a33-e8') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26624a33-e8, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:29:50 user nova-compute[73254]: INFO os_vif [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:04:fd:db,bridge_name='br-int',has_traffic_filtering=True,id=26624a33-e8c3-413f-944e-29a2b11e8d1b,network=Network(72c76653-cd29-4269-94c3-b374c77016e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26624a33-e8')
Aug 14 15:29:50 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Deleting instance files /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5_del
Aug 14 15:29:50 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Deletion of /opt/stack/data/nova/instances/97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5_del complete
Aug 14 15:29:50 user nova-compute[73254]: INFO nova.compute.manager [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 14 15:29:50 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:29:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-d9311f7c-7b8d-4ce6-a7e2-5daa6cf52d3d req-a661418c-9384-4ec6-b3c0-8585dfc44a0e service nova] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Received event network-vif-deleted-3a5860c4-3ed4-456c-8153-651e38223174 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:29:51 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:29:51 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Took 0.93 seconds to deallocate network for instance.
Aug 14 15:29:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:51 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:29:51 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:29:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.156s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:52 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Deleted allocations for instance 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5
Aug 14 15:29:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-9b6c3706-163d-4d38-8106-4ded4552ef0b tempest-SnapshotDataIntegrityTests-159888697 tempest-SnapshotDataIntegrityTests-159888697-project-member] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-25d9d4fc-fad1-40ed-acfc-0d62d4c2d034 req-c1a78ed2-8582-4d94-9bf9-74d6d8483274 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received event network-vif-plugged-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:29:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-25d9d4fc-fad1-40ed-acfc-0d62d4c2d034 req-c1a78ed2-8582-4d94-9bf9-74d6d8483274 service nova] Acquiring lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:29:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-25d9d4fc-fad1-40ed-acfc-0d62d4c2d034 req-c1a78ed2-8582-4d94-9bf9-74d6d8483274 service nova] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:29:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-25d9d4fc-fad1-40ed-acfc-0d62d4c2d034 req-c1a78ed2-8582-4d94-9bf9-74d6d8483274 service nova] Lock "97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:29:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-25d9d4fc-fad1-40ed-acfc-0d62d4c2d034 req-c1a78ed2-8582-4d94-9bf9-74d6d8483274 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] No waiting events found dispatching network-vif-plugged-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:29:52 user nova-compute[73254]: WARNING nova.compute.manager [req-25d9d4fc-fad1-40ed-acfc-0d62d4c2d034 req-c1a78ed2-8582-4d94-9bf9-74d6d8483274 service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received unexpected event network-vif-plugged-26624a33-e8c3-413f-944e-29a2b11e8d1b for instance with vm_state deleted and task_state None.
Aug 14 15:29:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-45eff3a1-7d7c-47ec-956f-96cd27b500fe req-df5f8c8a-b444-48d6-9b10-002952c82cda service nova] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Received event network-vif-deleted-26624a33-e8c3-413f-944e-29a2b11e8d1b {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:29:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:30:02 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026987.2306583, fcbc9f15-0f34-43b5-ad97-66c126e81405 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:30:02 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] VM Stopped (Lifecycle Event)
Aug 14 15:30:02 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c388eaae-090e-42e3-a496-a87b00b2194c None None] [instance: fcbc9f15-0f34-43b5-ad97-66c126e81405] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:30:05 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692026990.7487266, 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:30:05 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] VM Stopped (Lifecycle Event)
Aug 14 15:30:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:30:05 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a69ba4fc-455e-483e-a1af-9ff109817df1 None None] [instance: 97bbbe39-f87a-49a4-a8b8-c0abfe8d5cd5] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:30:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:30:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:30:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:30:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:30:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:30:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:30:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:30:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:30:18 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:30:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:30:19 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:30:19 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:30:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8608MB free_disk=25.180057525634766GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:30:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:30:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:30:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:30:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:30:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:30:19 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:30:19 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:30:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:30:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:30:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:21 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:30:23 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:30:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:30:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:30:26 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:30:26 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:30:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:30:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:30:26 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:30:26 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:30:27 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updating instance_info_cache with network_info: [{"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:30:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:30:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:30:28 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:30:28 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:30:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:30:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:30:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:30:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:30:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:30:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:30:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:30:32 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:30:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:30:48 user nova-compute[73254]: INFO nova.compute.manager [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Terminating instance
Aug 14 15:30:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-5a47a5cb-b511-4586-afbf-7eb64c5511b3 req-d032f9c1-12a1-41a8-b2e1-88509845b74f service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5a47a5cb-b511-4586-afbf-7eb64c5511b3 req-d032f9c1-12a1-41a8-b2e1-88509845b74f service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5a47a5cb-b511-4586-afbf-7eb64c5511b3 req-d032f9c1-12a1-41a8-b2e1-88509845b74f service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5a47a5cb-b511-4586-afbf-7eb64c5511b3 req-d032f9c1-12a1-41a8-b2e1-88509845b74f service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-5a47a5cb-b511-4586-afbf-7eb64c5511b3 req-d032f9c1-12a1-41a8-b2e1-88509845b74f service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:30:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-5a47a5cb-b511-4586-afbf-7eb64c5511b3 req-d032f9c1-12a1-41a8-b2e1-88509845b74f service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-unplugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:30:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Instance destroyed successfully.
Aug 14 15:30:49 user nova-compute[73254]: DEBUG nova.objects.instance [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'resources' on Instance uuid e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:21:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-16733886',display_name='tempest-AttachVolumeTestJSON-server-16733886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-16733886',id=41,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCxEAZaymEwwljUUm0bIND6+g7UStk6ayOY0oDvHBPzJ7vBCL0k+kKVFgHuWCAyGaHw+gdORl3+kdPOLWn88b3xmGLjBfM0KROLhtVxvGAVzsR9I/6NAtKreWeWvrEUlw==',key_name='tempest-keypair-1829711365',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:21:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-kumsk06a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:29:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=e94cdb72-c3cd-4d1f-a50f-934c2d9218f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "8e972792-3462-4547-84e7-bc0b50c37b06", "address": "fa:16:3e:5b:40:78", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e972792-34", "ovs_interfaceid": "8e972792-3462-4547-84e7-bc0b50c37b06", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG os_vif [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e972792-34, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:30:49 user nova-compute[73254]: INFO os_vif [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:40:78,bridge_name='br-int',has_traffic_filtering=True,id=8e972792-3462-4547-84e7-bc0b50c37b06,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e972792-34')
Aug 14 15:30:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Deleting instance files /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1_del
Aug 14 15:30:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Deletion of /opt/stack/data/nova/instances/e94cdb72-c3cd-4d1f-a50f-934c2d9218f1_del complete
Aug 14 15:30:49 user nova-compute[73254]: INFO nova.compute.manager [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 14 15:30:49 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:30:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:50 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:30:50 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Took 1.21 seconds to deallocate network for instance.
Aug 14 15:30:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-6c42bef5-5b9c-4fe3-8d07-32ad1c0c586e req-58cf71de-fc4a-4b8e-af9c-cf39c3b51559 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-deleted-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:30:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:30:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:30:50 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:30:50 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:30:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:30:50 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Deleted allocations for instance e94cdb72-c3cd-4d1f-a50f-934c2d9218f1
Aug 14 15:30:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-915c600f-2b62-4146-b846-86fa0bb5c88d req-7eed28f6-476d-430c-bf21-eabe9d5a8de9 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:30:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-915c600f-2b62-4146-b846-86fa0bb5c88d req-7eed28f6-476d-430c-bf21-eabe9d5a8de9 service nova] Acquiring lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:30:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-915c600f-2b62-4146-b846-86fa0bb5c88d req-7eed28f6-476d-430c-bf21-eabe9d5a8de9 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:30:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-915c600f-2b62-4146-b846-86fa0bb5c88d req-7eed28f6-476d-430c-bf21-eabe9d5a8de9 service nova] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:30:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-915c600f-2b62-4146-b846-86fa0bb5c88d req-7eed28f6-476d-430c-bf21-eabe9d5a8de9 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] No waiting events found dispatching network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:30:50 user nova-compute[73254]: WARNING nova.compute.manager [req-915c600f-2b62-4146-b846-86fa0bb5c88d req-7eed28f6-476d-430c-bf21-eabe9d5a8de9 service nova] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Received unexpected event network-vif-plugged-8e972792-3462-4547-84e7-bc0b50c37b06 for instance with vm_state deleted and task_state None.
Aug 14 15:30:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-62590af8-fedc-4092-9f66-ec549d1b15f7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "e94cdb72-c3cd-4d1f-a50f-934c2d9218f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.542s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:30:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:30:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:30:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:30:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:30:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:30:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:04 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692027049.3313353, e94cdb72-c3cd-4d1f-a50f-934c2d9218f1 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:31:04 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] VM Stopped (Lifecycle Event)
Aug 14 15:31:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-80827783-18c7-4bc7-b448-32d19d1ece29 None None] [instance: e94cdb72-c3cd-4d1f-a50f-934c2d9218f1] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:31:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:31:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:31:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:31:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:31:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:31:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:31:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:31:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:31:18 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:31:19 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:31:19 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=25.205455780029297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:31:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:31:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:31:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:31:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:31:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:31:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:31:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:31:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:31:29 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:31:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:31:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:31:32 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:31:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:31:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:31:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:31:42 user nova-compute[73254]: INFO nova.compute.claims [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Claim successful on node user
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:31:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:31:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Creating image(s)
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "/opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "/opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "/opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG nova.policy [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4518a054567744089ed8477a58377821', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05958df454f94ce5acc81cf06b929d27', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.174s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:31:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.177s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk 1073741824" returned: 0 in 0.060s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.192s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Successfully created port: f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Cannot resize image /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG nova.objects.instance [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'migration_context' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Ensure instance console log exists: /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:31:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Successfully updated port: f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquired lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-28154a89-020c-4584-80a8-c01c16f19a89 req-4a885e38-dc53-43fb-8104-7a03aeabea84 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received event network-changed-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-28154a89-020c-4584-80a8-c01c16f19a89 req-4a885e38-dc53-43fb-8104-7a03aeabea84 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Refreshing instance network info cache due to event network-changed-f7660f9d-59ce-4256-84a0-4cf7698e48da. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-28154a89-020c-4584-80a8-c01c16f19a89 req-4a885e38-dc53-43fb-8104-7a03aeabea84 service nova] Acquiring lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updating instance_info_cache with network_info: [{"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Releasing lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Instance network_info: |[{"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-28154a89-020c-4584-80a8-c01c16f19a89 req-4a885e38-dc53-43fb-8104-7a03aeabea84 service nova] Acquired lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.network.neutron [req-28154a89-020c-4584-80a8-c01c16f19a89 req-4a885e38-dc53-43fb-8104-7a03aeabea84 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Refreshing network info cache for port f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Start _get_guest_xml network_info=[{"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:31:44 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:31:44 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1092204525',display_name='tempest-AttachVolumeTestJSON-server-1092204525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1092204525',id=44,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4V50xp7Jh4lGf8ErlayKdHyQIH4c+QDdw/yDEQ/zSlwz8gLZ58vcpd9Xi5vwe7ndb0/1z60wMk0hwSgzva+TeRDZHud8JrwKl1JbrJUUpLYUUgAsc4KbzDgAatzb01ug==',key_name='tempest-keypair-1860209784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-5lnyicoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:31:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=066e5920-af4a-4dd6-97a3-40200f2e43cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a7:43,bridge_name='br-int',has_traffic_filtering=True,id=f7660f9d-59ce-4256-84a0-4cf7698e48da,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7660f9d-59') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.objects.instance [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'pci_devices' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:31:44 user nova-compute[73254]:   <uuid>066e5920-af4a-4dd6-97a3-40200f2e43cc</uuid>
Aug 14 15:31:44 user nova-compute[73254]:   <name>instance-0000002c</name>
Aug 14 15:31:44 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:31:44 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:31:44 user nova-compute[73254]:   <metadata>
Aug 14 15:31:44 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:31:44 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:31:44 user nova-compute[73254]:       <nova:name>tempest-AttachVolumeTestJSON-server-1092204525</nova:name>
Aug 14 15:31:44 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:31:44</nova:creationTime>
Aug 14 15:31:44 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:31:44 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:31:44 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:31:44 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:31:44 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:31:44 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:31:44 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:31:44 user nova-compute[73254]:       <nova:owner>
Aug 14 15:31:44 user nova-compute[73254]:         <nova:user uuid="4518a054567744089ed8477a58377821">tempest-AttachVolumeTestJSON-395337043-project-member</nova:user>
Aug 14 15:31:44 user nova-compute[73254]:         <nova:project uuid="05958df454f94ce5acc81cf06b929d27">tempest-AttachVolumeTestJSON-395337043</nova:project>
Aug 14 15:31:44 user nova-compute[73254]:       </nova:owner>
Aug 14 15:31:44 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:31:44 user nova-compute[73254]:       <nova:ports>
Aug 14 15:31:44 user nova-compute[73254]:         <nova:port uuid="f7660f9d-59ce-4256-84a0-4cf7698e48da">
Aug 14 15:31:44 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 15:31:44 user nova-compute[73254]:         </nova:port>
Aug 14 15:31:44 user nova-compute[73254]:       </nova:ports>
Aug 14 15:31:44 user nova-compute[73254]:     </nova:instance>
Aug 14 15:31:44 user nova-compute[73254]:   </metadata>
Aug 14 15:31:44 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:31:44 user nova-compute[73254]:     <system>
Aug 14 15:31:44 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:31:44 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:31:44 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:31:44 user nova-compute[73254]:       <entry name="serial">066e5920-af4a-4dd6-97a3-40200f2e43cc</entry>
Aug 14 15:31:44 user nova-compute[73254]:       <entry name="uuid">066e5920-af4a-4dd6-97a3-40200f2e43cc</entry>
Aug 14 15:31:44 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:31:44 user nova-compute[73254]:     </system>
Aug 14 15:31:44 user nova-compute[73254]:   </sysinfo>
Aug 14 15:31:44 user nova-compute[73254]:   <os>
Aug 14 15:31:44 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:31:44 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:31:44 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:31:44 user nova-compute[73254]:   </os>
Aug 14 15:31:44 user nova-compute[73254]:   <features>
Aug 14 15:31:44 user nova-compute[73254]:     <acpi/>
Aug 14 15:31:44 user nova-compute[73254]:     <apic/>
Aug 14 15:31:44 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:31:44 user nova-compute[73254]:   </features>
Aug 14 15:31:44 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:31:44 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:31:44 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:31:44 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:31:44 user nova-compute[73254]:   </clock>
Aug 14 15:31:44 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:31:44 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:31:44 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:31:44 user nova-compute[73254]:   </cpu>
Aug 14 15:31:44 user nova-compute[73254]:   <devices>
Aug 14 15:31:44 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:31:44 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:31:44 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk"/>
Aug 14 15:31:44 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:31:44 user nova-compute[73254]:     </disk>
Aug 14 15:31:44 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:31:44 user nova-compute[73254]:       <mac address="fa:16:3e:b6:a7:43"/>
Aug 14 15:31:44 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:31:44 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:31:44 user nova-compute[73254]:       <target dev="tapf7660f9d-59"/>
Aug 14 15:31:44 user nova-compute[73254]:     </interface>
Aug 14 15:31:44 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:31:44 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/console.log" append="off"/>
Aug 14 15:31:44 user nova-compute[73254]:     </serial>
Aug 14 15:31:44 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:31:44 user nova-compute[73254]:     <video>
Aug 14 15:31:44 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:31:44 user nova-compute[73254]:     </video>
Aug 14 15:31:44 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:31:44 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:31:44 user nova-compute[73254]:     </rng>
Aug 14 15:31:44 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:31:44 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:31:44 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:31:44 user nova-compute[73254]:     </memballoon>
Aug 14 15:31:44 user nova-compute[73254]:   </devices>
Aug 14 15:31:44 user nova-compute[73254]: </domain>
Aug 14 15:31:44 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1092204525',display_name='tempest-AttachVolumeTestJSON-server-1092204525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1092204525',id=44,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4V50xp7Jh4lGf8ErlayKdHyQIH4c+QDdw/yDEQ/zSlwz8gLZ58vcpd9Xi5vwe7ndb0/1z60wMk0hwSgzva+TeRDZHud8JrwKl1JbrJUUpLYUUgAsc4KbzDgAatzb01ug==',key_name='tempest-keypair-1860209784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-5lnyicoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:31:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=066e5920-af4a-4dd6-97a3-40200f2e43cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a7:43,bridge_name='br-int',has_traffic_filtering=True,id=f7660f9d-59ce-4256-84a0-4cf7698e48da,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7660f9d-59') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG os_vif [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a7:43,bridge_name='br-int',has_traffic_filtering=True,id=f7660f9d-59ce-4256-84a0-4cf7698e48da,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7660f9d-59') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7660f9d-59, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf7660f9d-59, col_values=(('external_ids', {'iface-id': 'f7660f9d-59ce-4256-84a0-4cf7698e48da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:a7:43', 'vm-uuid': '066e5920-af4a-4dd6-97a3-40200f2e43cc'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:44 user nova-compute[73254]: INFO os_vif [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:a7:43,bridge_name='br-int',has_traffic_filtering=True,id=f7660f9d-59ce-4256-84a0-4cf7698e48da,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7660f9d-59')
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:31:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No VIF found with MAC fa:16:3e:b6:a7:43, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:31:45 user nova-compute[73254]: DEBUG nova.network.neutron [req-28154a89-020c-4584-80a8-c01c16f19a89 req-4a885e38-dc53-43fb-8104-7a03aeabea84 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updated VIF entry in instance network info cache for port f7660f9d-59ce-4256-84a0-4cf7698e48da. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:31:45 user nova-compute[73254]: DEBUG nova.network.neutron [req-28154a89-020c-4584-80a8-c01c16f19a89 req-4a885e38-dc53-43fb-8104-7a03aeabea84 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updating instance_info_cache with network_info: [{"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:31:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-28154a89-020c-4584-80a8-c01c16f19a89 req-4a885e38-dc53-43fb-8104-7a03aeabea84 service nova] Releasing lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:31:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-26fe3fdb-e03b-41b5-b364-1f65643d8dce req-953aaa4b-e490-479a-b9d9-c0dd6fccab65 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received event network-vif-plugged-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:31:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-26fe3fdb-e03b-41b5-b364-1f65643d8dce req-953aaa4b-e490-479a-b9d9-c0dd6fccab65 service nova] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:31:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-26fe3fdb-e03b-41b5-b364-1f65643d8dce req-953aaa4b-e490-479a-b9d9-c0dd6fccab65 service nova] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:31:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-26fe3fdb-e03b-41b5-b364-1f65643d8dce req-953aaa4b-e490-479a-b9d9-c0dd6fccab65 service nova] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:31:46 user nova-compute[73254]: DEBUG nova.compute.manager [req-26fe3fdb-e03b-41b5-b364-1f65643d8dce req-953aaa4b-e490-479a-b9d9-c0dd6fccab65 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] No waiting events found dispatching network-vif-plugged-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:31:46 user nova-compute[73254]: WARNING nova.compute.manager [req-26fe3fdb-e03b-41b5-b364-1f65643d8dce req-953aaa4b-e490-479a-b9d9-c0dd6fccab65 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received unexpected event network-vif-plugged-f7660f9d-59ce-4256-84a0-4cf7698e48da for instance with vm_state building and task_state spawning.
Aug 14 15:31:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692027108.2993083, 066e5920-af4a-4dd6-97a3-40200f2e43cc => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:31:48 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] VM Resumed (Lifecycle Event)
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:31:48 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Instance spawned successfully.
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:31:48 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692027108.3006647, 066e5920-af4a-4dd6-97a3-40200f2e43cc => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:31:48 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] VM Started (Lifecycle Event)
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:31:48 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-238d566e-db34-451e-bdbb-45ea115126ba req-96d823b1-4703-4399-a588-5c6c89ed8039 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received event network-vif-plugged-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-238d566e-db34-451e-bdbb-45ea115126ba req-96d823b1-4703-4399-a588-5c6c89ed8039 service nova] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-238d566e-db34-451e-bdbb-45ea115126ba req-96d823b1-4703-4399-a588-5c6c89ed8039 service nova] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-238d566e-db34-451e-bdbb-45ea115126ba req-96d823b1-4703-4399-a588-5c6c89ed8039 service nova] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-238d566e-db34-451e-bdbb-45ea115126ba req-96d823b1-4703-4399-a588-5c6c89ed8039 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] No waiting events found dispatching network-vif-plugged-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:31:48 user nova-compute[73254]: WARNING nova.compute.manager [req-238d566e-db34-451e-bdbb-45ea115126ba req-96d823b1-4703-4399-a588-5c6c89ed8039 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received unexpected event network-vif-plugged-f7660f9d-59ce-4256-84a0-4cf7698e48da for instance with vm_state building and task_state spawning.
Aug 14 15:31:48 user nova-compute[73254]: INFO nova.compute.manager [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Took 5.66 seconds to spawn the instance on the hypervisor.
Aug 14 15:31:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:31:48 user nova-compute[73254]: INFO nova.compute.manager [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Took 6.16 seconds to build instance.
Aug 14 15:31:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-17bf9f49-5acf-4ab7-981a-facb29dbadc7 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.249s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:31:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:31:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:19 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:32:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:32:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:32:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:32:19 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:32:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:32:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:32:19 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:32:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:32:20 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:32:20 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:32:20 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=25.175704956054688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:32:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:32:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:32:20 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 066e5920-af4a-4dd6-97a3-40200f2e43cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:32:20 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:32:20 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:32:20 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:32:20 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:32:20 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:32:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:32:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:32:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:32:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:32:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:32:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:32:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:32:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:32:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:32:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:32:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:32:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:32:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:32:27 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:32:27 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:32:28 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updating instance_info_cache with network_info: [{"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:32:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:32:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:32:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:32:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:32:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:32:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:32:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:32:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:32:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:32:32 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:32:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:32:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:32:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:32:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:32:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:32:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:32:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:32:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:32:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:33:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:33:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:33:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:33:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:33:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:20 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:33:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:33:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:33:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:33:20 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:33:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:20 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:21 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:21 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:33:21 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:33:21 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8808MB free_disk=25.167320251464844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:33:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:33:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:33:21 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 066e5920-af4a-4dd6-97a3-40200f2e43cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:33:21 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:33:21 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:33:21 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:33:21 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:33:21 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:33:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:33:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:33:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:33:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:33:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:33:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:30 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updating instance_info_cache with network_info: [{"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:33:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:33:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:33:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:33:32 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:33:32 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:33:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:33:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:33:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-504f1b10-4d70-4ed3-9ac6-9c2ec23fd48e req-88ff47ec-5f1d-4464-b1b8-952a6c74fda9 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received event network-changed-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:33:33 user nova-compute[73254]: DEBUG nova.compute.manager [req-504f1b10-4d70-4ed3-9ac6-9c2ec23fd48e req-88ff47ec-5f1d-4464-b1b8-952a6c74fda9 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Refreshing instance network info cache due to event network-changed-f7660f9d-59ce-4256-84a0-4cf7698e48da. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:33:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-504f1b10-4d70-4ed3-9ac6-9c2ec23fd48e req-88ff47ec-5f1d-4464-b1b8-952a6c74fda9 service nova] Acquiring lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:33:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-504f1b10-4d70-4ed3-9ac6-9c2ec23fd48e req-88ff47ec-5f1d-4464-b1b8-952a6c74fda9 service nova] Acquired lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:33:33 user nova-compute[73254]: DEBUG nova.network.neutron [req-504f1b10-4d70-4ed3-9ac6-9c2ec23fd48e req-88ff47ec-5f1d-4464-b1b8-952a6c74fda9 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Refreshing network info cache for port f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:33:34 user nova-compute[73254]: DEBUG nova.network.neutron [req-504f1b10-4d70-4ed3-9ac6-9c2ec23fd48e req-88ff47ec-5f1d-4464-b1b8-952a6c74fda9 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updated VIF entry in instance network info cache for port f7660f9d-59ce-4256-84a0-4cf7698e48da. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:33:34 user nova-compute[73254]: DEBUG nova.network.neutron [req-504f1b10-4d70-4ed3-9ac6-9c2ec23fd48e req-88ff47ec-5f1d-4464-b1b8-952a6c74fda9 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updating instance_info_cache with network_info: [{"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:33:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-504f1b10-4d70-4ed3-9ac6-9c2ec23fd48e req-88ff47ec-5f1d-4464-b1b8-952a6c74fda9 service nova] Releasing lock "refresh_cache-066e5920-af4a-4dd6-97a3-40200f2e43cc" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:33:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG nova.objects.instance [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:33:37 user nova-compute[73254]: INFO nova.compute.manager [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Attaching volume 53c7dc85-507c-41ea-a59d-45834bc760e5 to /dev/vdb
Aug 14 15:33:37 user nova-compute[73254]: DEBUG os_brick.utils [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4b8d23-7ee2-4cd3-a4c5-e0195dfd967a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe14fc5-782d-42b1-b839-b16f9907e30f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3a3d5b-c159-4f83-a10d-082bd2ba5da5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7020aad0-9304-4a86-86a7-d6d62544d53c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:33:37 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:33:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2cc855-bbd8-40c6-9d4e-24f66576a09a]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG os_brick.utils [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:33:37 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updating existing volume attachment record: 4f5b5412-8f14-451e-8c43-f544ace2ca7e {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:33:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:33:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJniEHCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:33:45 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:33:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:33:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:33:45 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:33:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:33:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:33:45 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:33:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:45 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[87db07bb-4911-44e2-a6bb-f51dbcba00b1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:45 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:33:45 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:33:45 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[817883c7-db37-49c5-8c84-7a3627a1087f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5] added
Aug 14 15:33:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a710f1a4-1b1d-4f6a-9ab1-dbb16ae81812]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e308f7-f489-4856-8c7f-958d1f7b52b7]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sJniEHCR {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sJniEHCR" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8efb7a1f-4c25-4816-8c12-aff5762932ae]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sJniEHCR'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bd222c-cca5-4a6b-a61a-48c9576af74c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab0ee33-137e-478d-bb40-23ae4ba82262]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:33:46 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:33:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:33:46 user nova-compute[73254]:  {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:33:46 user nova-compute[73254]: WARNING os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 15:33:46 user nova-compute[73254]: 
Aug 14 15:33:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --login" returned: 0 in 1.047s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd81932-6208-4685-9e7f-bbdb6edb1f39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5, portal: 172.16.0.220,3260]
Aug 14 15:33:47 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5, portal: 172.16.0.220,3260] successful.
Aug 14 15:33:47 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae849a8-d745-4054-9d3a-302d684bf58b]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f27a32d-9d1a-4d46-881a-d48a2db6a4d1]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)
Aug 14 15:33:47 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)
Aug 14 15:33:47 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.235s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[22863315-d9fd-4cfd-8cbb-4dd9336f06e2]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:33:47 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJniEHCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:33:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.269s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:33:48 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== connect_volume: return (2271ms) {'type': 'block', 'scsi_wwn': '23265333833356139', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:33:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265333833356139', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:33:48 user nova-compute[73254]: DEBUG nova.objects.instance [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:33:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:33:48 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:33:48 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:33:48 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:33:48 user nova-compute[73254]:   <serial>53c7dc85-507c-41ea-a59d-45834bc760e5</serial>
Aug 14 15:33:48 user nova-compute[73254]: </disk>
Aug 14 15:33:48 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:33:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:33:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:33:48 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No VIF found with MAC fa:16:3e:b6:a7:43, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:33:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bcb4e82d-6098-499a-a63c-6f65f55fd89b tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.090s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:33:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:33:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:33:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:33:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:33:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Verify base images {{(pid=73254) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Image id 5e61edbd-805a-4552-b424-f092693ae8cc yields fingerprint 15000720ae0601f4620e84fffcd9d21aa7a462bc {{(pid=73254) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] image 5e61edbd-805a-4552-b424-f092693ae8cc at (/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc): checking
Aug 14 15:33:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] image 5e61edbd-805a-4552-b424-f092693ae8cc at (/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc): image is in use {{(pid=73254) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73254) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] 066e5920-af4a-4dd6-97a3-40200f2e43cc is a valid instance name {{(pid=73254) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] 066e5920-af4a-4dd6-97a3-40200f2e43cc has a disk file {{(pid=73254) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 066e5920-af4a-4dd6-97a3-40200f2e43cc is backed by 15000720ae0601f4620e84fffcd9d21aa7a462bc {{(pid=73254) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 14 15:33:51 user nova-compute[73254]: WARNING nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Unknown base file: /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7
Aug 14 15:33:51 user nova-compute[73254]: WARNING nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Unknown base file: /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72
Aug 14 15:33:51 user nova-compute[73254]: WARNING nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Unknown base file: /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2
Aug 14 15:33:51 user nova-compute[73254]: WARNING nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Unknown base file: /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba
Aug 14 15:33:51 user nova-compute[73254]: WARNING nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Unknown base file: /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205
Aug 14 15:33:51 user nova-compute[73254]: WARNING nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Unknown base file: /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809
Aug 14 15:33:51 user nova-compute[73254]: WARNING nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Unknown base file: /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518
Aug 14 15:33:51 user nova-compute[73254]: WARNING nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Unknown base file: /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a
Aug 14 15:33:51 user nova-compute[73254]: WARNING nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Unknown base file: /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Active base files: /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Removable base files: /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7 /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72 /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2 /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205 /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809 /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518 /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9fbab118b1236fd554d25752bfcfb63d2d092fd7
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0b669b6d5d81b5be56f314fc1aae85ad3a737c72
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/972ef8209b164c7cdb417f33a714f8be743d77e2
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f88075acd80977132aeb73538bb39d0c92358dba
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/73e9720f7296a0ec0c4d44ee7033cd4e997f0205
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/32ccd76e71d55e429484cd8917e797acdd49f809
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9910d2a89161e43d5b8d2e3b9995b172b8c78518
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9f1d9e710686943fd923213c7a25acae3b98073a
Aug 14 15:33:51 user nova-compute[73254]: INFO nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6bded5ebc628bcfa7f88c3cb7c894fc2fa954eb2
Aug 14 15:33:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Verification complete {{(pid=73254) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Verify swap images {{(pid=73254) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 14 15:33:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.imagecache [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Verify ephemeral images {{(pid=73254) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 14 15:33:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:33:53 user nova-compute[73254]: INFO nova.compute.manager [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Attaching volume b0080181-9cae-4267-b31a-f124a9721dcf to /dev/vdc
Aug 14 15:33:53 user nova-compute[73254]: DEBUG os_brick.utils [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a84e02-4138-417c-88c6-57a85318b455]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec422d72-20d6-473d-9071-abe20975e352]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7613a92c-5a1c-41f3-ad80-b13d7dd3f84b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3a31c5-1905-444d-b62a-d5efd75b9ec0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:33:53 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:33:53 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2a3ef9-d9a5-463f-8c07-9511db2732f0]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG os_brick.utils [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:33:53 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updating existing volume attachment record: 79605e94-02f8-4a79-89ba-4600f3e2ec97 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:33:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:33:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbSCizBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:34:01 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:34:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:34:01 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:34:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:34:01 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5af69-85cf-483a-aee3-5cbb166caa7b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:34:01 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c0810-6fd3-4cea-acd9-aa76121cdd5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf] added
Aug 14 15:34:01 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4069be21-d1ce-4799-a629-8d478e9e00ca]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4c613d-d296-4b4c-93c3-96536863e95a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbSCizBv {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EbSCizBv" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3893b3-73ba-48f0-8821-b4a194a83d7a]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EbSCizBv'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:01 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fae6cfb-ac74-4f71-9b9b-f9c11bfe5978]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9bc8fb-1336-413b-b6a0-2f443f8dcc73]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)
Aug 14 15:34:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)
Aug 14 15:34:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6183b0-325c-4c35-8ea5-c8111a07b301]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf, portal: 172.16.0.220,3260]
Aug 14 15:34:02 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf, portal: 172.16.0.220,3260] successful.
Aug 14 15:34:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[58275166-4666-4772-bfd2-7a32cc1360a9]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccc8e7f-2abc-4b51-97f5-f85a4f99c647]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)
Aug 14 15:34:02 user nova-compute[73254]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf (non-flash)
Aug 14 15:34:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)
Aug 14 15:34:02 user nova-compute[73254]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf (non-flash)
Aug 14 15:34:02 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8a47ae-9493-4bb2-891f-f94f2fbca699]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:02 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbSCizBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26137653133366131', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137653133366131', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] attach device xml: <disk type="block" device="disk">
Aug 14 15:34:03 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:34:03 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:34:03 user nova-compute[73254]:   <target dev="vdc" bus="virtio"/>
Aug 14 15:34:03 user nova-compute[73254]:   <serial>b0080181-9cae-4267-b31a-f124a9721dcf</serial>
Aug 14 15:34:03 user nova-compute[73254]: </disk>
Aug 14 15:34:03 user nova-compute[73254]:  {{(pid=73254) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] No VIF found with MAC fa:16:3e:b6:a7:43, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:34:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0f479820-7baf-40d5-9f6c-07c5be699ec3 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.381s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:34:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:34:04 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:34:04 user nova-compute[73254]: INFO nova.compute.manager [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Detaching volume 53c7dc85-507c-41ea-a59d-45834bc760e5
Aug 14 15:34:04 user nova-compute[73254]: INFO nova.virt.block_device [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Attempting to driver detach volume 53c7dc85-507c-41ea-a59d-45834bc760e5 from mountpoint /dev/vdb
Aug 14 15:34:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Attempting to detach device vdb from instance 066e5920-af4a-4dd6-97a3-40200f2e43cc from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:34:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:34:04 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:34:04 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:34:04 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:34:04 user nova-compute[73254]:   <serial>53c7dc85-507c-41ea-a59d-45834bc760e5</serial>
Aug 14 15:34:04 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:34:04 user nova-compute[73254]: </disk>
Aug 14 15:34:04 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:34:04 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully detached device vdb from instance 066e5920-af4a-4dd6-97a3-40200f2e43cc from the persistent domain config.
Aug 14 15:34:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 066e5920-af4a-4dd6-97a3-40200f2e43cc from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:34:04 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:34:04 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:34:04 user nova-compute[73254]:   <source dev="/dev/sdb"/>
Aug 14 15:34:04 user nova-compute[73254]:   <target dev="vdb" bus="virtio"/>
Aug 14 15:34:04 user nova-compute[73254]:   <serial>53c7dc85-507c-41ea-a59d-45834bc760e5</serial>
Aug 14 15:34:04 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 14 15:34:04 user nova-compute[73254]: </disk>
Aug 14 15:34:04 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:34:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:34:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:34:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:34:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:34:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692027245.3017142, 066e5920-af4a-4dd6-97a3-40200f2e43cc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:34:05 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully detached device vdb from instance 066e5920-af4a-4dd6-97a3-40200f2e43cc from the live domain config.
Aug 14 15:34:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sJniEHCR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:34:05 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9451f88c-aab6-4a1f-a558-bb89a37b62dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cc84e9-d1ec-49d1-89c1-d99bef0eb497]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)
Aug 14 15:34:05 user nova-compute[73254]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf (non-flash)
Aug 14 15:34:05 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 (non-flash)
Aug 14 15:34:05 user nova-compute[73254]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf (non-flash)
Aug 14 15:34:05 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd668551f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2df1f8-4438-4b46-86f8-8bfad1ef6b57]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb94204c-a61e-4806-b3f5-0801fdf64d58]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8429048e-8c86-413d-bf75-da8531c22176]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf706d9e-0322-4daf-bdf8-8a6aa863968d]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[78010c01-ef6b-42b0-8eb1-5fa6efdec9ce]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee68c91-dcdf-4e85-a23d-7674c8fb9d91]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5, portal: 172.16.0.220,3260]
Aug 14 15:34:05 user nova-compute[73254]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5, portal: 172.16.0.220,3260] successful.
Aug 14 15:34:05 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53c7dc85-507c-41ea-a59d-45834bc760e5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2509662-5339-44a1-adb1-ef8bbaded980]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== disconnect_volume: return (280ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:34:05 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:34:06 user nova-compute[73254]: DEBUG nova.objects.instance [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:34:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-85690da9-03da-402c-9880-8cd7e3e17806 tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.893s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:34:07 user nova-compute[73254]: INFO nova.compute.manager [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Detaching volume b0080181-9cae-4267-b31a-f124a9721dcf
Aug 14 15:34:07 user nova-compute[73254]: INFO nova.virt.block_device [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Attempting to driver detach volume b0080181-9cae-4267-b31a-f124a9721dcf from mountpoint /dev/vdc
Aug 14 15:34:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Attempting to detach device vdc from instance 066e5920-af4a-4dd6-97a3-40200f2e43cc from the persistent domain config. {{(pid=73254) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:34:07 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:34:07 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:34:07 user nova-compute[73254]:   <target dev="vdc" bus="virtio"/>
Aug 14 15:34:07 user nova-compute[73254]:   <serial>b0080181-9cae-4267-b31a-f124a9721dcf</serial>
Aug 14 15:34:07 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 15:34:07 user nova-compute[73254]: </disk>
Aug 14 15:34:07 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:34:07 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully detached device vdc from instance 066e5920-af4a-4dd6-97a3-40200f2e43cc from the persistent domain config.
Aug 14 15:34:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 066e5920-af4a-4dd6-97a3-40200f2e43cc from the live domain config. {{(pid=73254) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.guest [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] detach device xml: <disk type="block" device="disk">
Aug 14 15:34:07 user nova-compute[73254]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:34:07 user nova-compute[73254]:   <source dev="/dev/sdc"/>
Aug 14 15:34:07 user nova-compute[73254]:   <target dev="vdc" bus="virtio"/>
Aug 14 15:34:07 user nova-compute[73254]:   <serial>b0080181-9cae-4267-b31a-f124a9721dcf</serial>
Aug 14 15:34:07 user nova-compute[73254]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 14 15:34:07 user nova-compute[73254]: </disk>
Aug 14 15:34:07 user nova-compute[73254]:  {{(pid=73254) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Received event <DeviceRemovedEvent: 1692027247.7376254, 066e5920-af4a-4dd6-97a3-40200f2e43cc => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73254) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 14 15:34:07 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully detached device vdc from instance 066e5920-af4a-4dd6-97a3-40200f2e43cc from the live domain config.
Aug 14 15:34:07 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EbSCizBv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:34:07 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dc0e53-78cb-419f-bd17-7d019307e1ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b3c0af-cf38-432d-b136-622703c99c54]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf (non-flash)
Aug 14 15:34:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf (non-flash)
Aug 14 15:34:07 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648690310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef96da8-bc15-4b11-8d8d-d2d6b5012f43]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[444d45bc-19cb-4dfe-903c-c23e5dc177e5]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c019ec-0fba-4865-b959-3f62088bb1ac]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c023760-62a2-48e2-8e8e-2fe46c20f901]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f11061f-9caf-4e98-ac2a-8632e0ee2f93]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:07 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49225ab-a48e-4691-96c4-89578605473a]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf, portal: 172.16.0.220,3260]
Aug 14 15:34:08 user nova-compute[73254]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf, portal: 172.16.0.220,3260] successful.
Aug 14 15:34:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0080181-9cae-4267-b31a-f124a9721dcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c89a32-de0a-4e31-b371-c522e769faf5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] <== disconnect_volume: return (280ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'flavor' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:34:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5a4dfb24-9c6d-4069-bcf8-21848b09044d tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.604s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:34:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:34:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:34:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:34:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:34:09 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:34:09 user nova-compute[73254]: INFO nova.compute.manager [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Terminating instance
Aug 14 15:34:09 user nova-compute[73254]: DEBUG nova.compute.manager [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:34:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-9de37b5d-1729-4447-9ca3-6e85f3643f3f req-4613707e-feed-455f-8a78-428cee272045 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received event network-vif-unplugged-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9de37b5d-1729-4447-9ca3-6e85f3643f3f req-4613707e-feed-455f-8a78-428cee272045 service nova] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9de37b5d-1729-4447-9ca3-6e85f3643f3f req-4613707e-feed-455f-8a78-428cee272045 service nova] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9de37b5d-1729-4447-9ca3-6e85f3643f3f req-4613707e-feed-455f-8a78-428cee272045 service nova] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-9de37b5d-1729-4447-9ca3-6e85f3643f3f req-4613707e-feed-455f-8a78-428cee272045 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] No waiting events found dispatching network-vif-unplugged-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-9de37b5d-1729-4447-9ca3-6e85f3643f3f req-4613707e-feed-455f-8a78-428cee272045 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received event network-vif-unplugged-f7660f9d-59ce-4256-84a0-4cf7698e48da for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Instance destroyed successfully.
Aug 14 15:34:10 user nova-compute[73254]: DEBUG nova.objects.instance [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lazy-loading 'resources' on Instance uuid 066e5920-af4a-4dd6-97a3-40200f2e43cc {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:31:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1092204525',display_name='tempest-AttachVolumeTestJSON-server-1092204525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1092204525',id=44,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4V50xp7Jh4lGf8ErlayKdHyQIH4c+QDdw/yDEQ/zSlwz8gLZ58vcpd9Xi5vwe7ndb0/1z60wMk0hwSgzva+TeRDZHud8JrwKl1JbrJUUpLYUUgAsc4KbzDgAatzb01ug==',key_name='tempest-keypair-1860209784',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:31:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05958df454f94ce5acc81cf06b929d27',ramdisk_id='',reservation_id='r-5lnyicoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-395337043',owner_user_name='tempest-AttachVolumeTestJSON-395337043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:31:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4518a054567744089ed8477a58377821',uuid=066e5920-af4a-4dd6-97a3-40200f2e43cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converting VIF {"id": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "address": "fa:16:3e:b6:a7:43", "network": {"id": "7e97ba7e-ee21-4ccc-b340-90d33bc4e106", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1745081678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05958df454f94ce5acc81cf06b929d27", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7660f9d-59", "ovs_interfaceid": "f7660f9d-59ce-4256-84a0-4cf7698e48da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:a7:43,bridge_name='br-int',has_traffic_filtering=True,id=f7660f9d-59ce-4256-84a0-4cf7698e48da,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7660f9d-59') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG os_vif [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:a7:43,bridge_name='br-int',has_traffic_filtering=True,id=f7660f9d-59ce-4256-84a0-4cf7698e48da,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7660f9d-59') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7660f9d-59, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:10 user nova-compute[73254]: INFO os_vif [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:a7:43,bridge_name='br-int',has_traffic_filtering=True,id=f7660f9d-59ce-4256-84a0-4cf7698e48da,network=Network(7e97ba7e-ee21-4ccc-b340-90d33bc4e106),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7660f9d-59')
Aug 14 15:34:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Deleting instance files /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc_del
Aug 14 15:34:10 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Deletion of /opt/stack/data/nova/instances/066e5920-af4a-4dd6-97a3-40200f2e43cc_del complete
Aug 14 15:34:10 user nova-compute[73254]: INFO nova.compute.manager [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 14 15:34:10 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:34:10 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:34:11 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:34:11 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Took 0.93 seconds to deallocate network for instance.
Aug 14 15:34:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-f5efac5b-564b-4ff2-992a-fd5a147744e7 req-a0b0633d-589d-4eee-a71d-60da9967a1db service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received event network-vif-deleted-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:34:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:34:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:34:11 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:34:11 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:34:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.110s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:34:11 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Deleted allocations for instance 066e5920-af4a-4dd6-97a3-40200f2e43cc
Aug 14 15:34:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-6f39875e-5a4b-47c1-965d-2c61eec9befc tempest-AttachVolumeTestJSON-395337043 tempest-AttachVolumeTestJSON-395337043-project-member] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.060s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:34:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-d8848894-7308-48c4-a73c-c30eccb062ea req-7f4e5337-fda0-4323-8ac8-b5ab87afee05 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received event network-vif-plugged-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:34:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d8848894-7308-48c4-a73c-c30eccb062ea req-7f4e5337-fda0-4323-8ac8-b5ab87afee05 service nova] Acquiring lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:34:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d8848894-7308-48c4-a73c-c30eccb062ea req-7f4e5337-fda0-4323-8ac8-b5ab87afee05 service nova] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:34:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d8848894-7308-48c4-a73c-c30eccb062ea req-7f4e5337-fda0-4323-8ac8-b5ab87afee05 service nova] Lock "066e5920-af4a-4dd6-97a3-40200f2e43cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:34:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-d8848894-7308-48c4-a73c-c30eccb062ea req-7f4e5337-fda0-4323-8ac8-b5ab87afee05 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] No waiting events found dispatching network-vif-plugged-f7660f9d-59ce-4256-84a0-4cf7698e48da {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:34:12 user nova-compute[73254]: WARNING nova.compute.manager [req-d8848894-7308-48c4-a73c-c30eccb062ea req-7f4e5337-fda0-4323-8ac8-b5ab87afee05 service nova] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Received unexpected event network-vif-plugged-f7660f9d-59ce-4256-84a0-4cf7698e48da for instance with vm_state deleted and task_state None.
Aug 14 15:34:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:18 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:18 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:34:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:34:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:34:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:34:22 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:34:23 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:34:23 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:34:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8939MB free_disk=25.193527221679688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:34:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:34:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:34:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:34:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:34:23 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:34:23 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:34:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:34:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:34:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:25 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692027250.5500553, 066e5920-af4a-4dd6-97a3-40200f2e43cc => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:34:25 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] VM Stopped (Lifecycle Event)
Aug 14 15:34:25 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3ab78561-ca45-47fe-90fd-94facdf1811d None None] [instance: 066e5920-af4a-4dd6-97a3-40200f2e43cc] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:34:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:34:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:34:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:34:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:34:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:34:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:34:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:34:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:32 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:34:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:34:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:34:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:34:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:34:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:34:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:34:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:34:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:34:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:34:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:34:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:34:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:35:07 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:35:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:35:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:35:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:35:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:35:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:35:22 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:35:23 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:35:23 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:35:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8961MB free_disk=25.192394256591797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:35:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:35:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:35:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:35:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:35:23 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:35:23 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:35:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:35:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:35:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:26 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:35:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:35:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:35:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:35:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:35:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:35:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:35:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:35:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:35:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:35:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:35:35 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:35:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:35:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:35:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:35:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:35:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:35:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:35:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:36:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:36:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:36:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:36:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:36:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:36:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:36:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:36:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:36:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:36:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:36:22 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:36:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:36:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:36:22 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:36:22 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:36:23 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:36:23 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8972MB free_disk=25.190532684326172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:36:23 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:36:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:36:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:36:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:36:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:36:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:36:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:36:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:36:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:36:28 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:36:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:36:32 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:36:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:36:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:36:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:36:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:36:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:36:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:36:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:36:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:36:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:36:38 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:36:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:36:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:36:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:36:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "a205ec03-7e16-43fb-be78-8a081027604c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "a205ec03-7e16-43fb-be78-8a081027604c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:37:15 user nova-compute[73254]: INFO nova.compute.claims [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Claim successful on node user
Aug 14 15:37:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.197s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:37:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:37:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:37:15 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Creating image(s)
Aug 14 15:37:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "/opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "/opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "/opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:37:15 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG nova.policy [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'edcba0e9c0be48c3b44606ac81c69334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bc3c8780fa4bf4a81079668aceafa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk 1073741824" returned: 0 in 0.048s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.174s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Successfully created port: 96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Cannot resize image /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG nova.objects.instance [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lazy-loading 'migration_context' on Instance uuid a205ec03-7e16-43fb-be78-8a081027604c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Ensure instance console log exists: /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:37:16 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Successfully updated port: 96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquired lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-368eb1c2-e2dd-4e08-a974-06c7fe399451 req-fab58a1d-8363-4d18-b482-d4f5c1b5a113 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Received event network-changed-96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.compute.manager [req-368eb1c2-e2dd-4e08-a974-06c7fe399451 req-fab58a1d-8363-4d18-b482-d4f5c1b5a113 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Refreshing instance network info cache due to event network-changed-96535eb7-9828-46f1-b00c-ddfd5956838f. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-368eb1c2-e2dd-4e08-a974-06c7fe399451 req-fab58a1d-8363-4d18-b482-d4f5c1b5a113 service nova] Acquiring lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Updating instance_info_cache with network_info: [{"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Releasing lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Instance network_info: |[{"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-368eb1c2-e2dd-4e08-a974-06c7fe399451 req-fab58a1d-8363-4d18-b482-d4f5c1b5a113 service nova] Acquired lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.network.neutron [req-368eb1c2-e2dd-4e08-a974-06c7fe399451 req-fab58a1d-8363-4d18-b482-d4f5c1b5a113 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Refreshing network info cache for port 96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Start _get_guest_xml network_info=[{"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:37:17 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:37:17 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:37:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-331854924',display_name='tempest-VolumesActionsTest-instance-331854924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-331854924',id=45,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97bc3c8780fa4bf4a81079668aceafa7',ramdisk_id='',reservation_id='r-voscs4ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1721189150',owner_user_name='tempest-VolumesActionsTest-1721189150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:37:16Z,user_data=None,user_id='edcba0e9c0be48c3b44606ac81c69334',uuid=a205ec03-7e16-43fb-be78-8a081027604c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converting VIF {"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:bb:69,bridge_name='br-int',has_traffic_filtering=True,id=96535eb7-9828-46f1-b00c-ddfd5956838f,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96535eb7-98') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.objects.instance [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lazy-loading 'pci_devices' on Instance uuid a205ec03-7e16-43fb-be78-8a081027604c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:37:17 user nova-compute[73254]:   <uuid>a205ec03-7e16-43fb-be78-8a081027604c</uuid>
Aug 14 15:37:17 user nova-compute[73254]:   <name>instance-0000002d</name>
Aug 14 15:37:17 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:37:17 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:37:17 user nova-compute[73254]:   <metadata>
Aug 14 15:37:17 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:37:17 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:37:17 user nova-compute[73254]:       <nova:name>tempest-VolumesActionsTest-instance-331854924</nova:name>
Aug 14 15:37:17 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:37:17</nova:creationTime>
Aug 14 15:37:17 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:37:17 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:37:17 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:37:17 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:37:17 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:37:17 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:37:17 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:37:17 user nova-compute[73254]:       <nova:owner>
Aug 14 15:37:17 user nova-compute[73254]:         <nova:user uuid="edcba0e9c0be48c3b44606ac81c69334">tempest-VolumesActionsTest-1721189150-project-member</nova:user>
Aug 14 15:37:17 user nova-compute[73254]:         <nova:project uuid="97bc3c8780fa4bf4a81079668aceafa7">tempest-VolumesActionsTest-1721189150</nova:project>
Aug 14 15:37:17 user nova-compute[73254]:       </nova:owner>
Aug 14 15:37:17 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:37:17 user nova-compute[73254]:       <nova:ports>
Aug 14 15:37:17 user nova-compute[73254]:         <nova:port uuid="96535eb7-9828-46f1-b00c-ddfd5956838f">
Aug 14 15:37:17 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 14 15:37:17 user nova-compute[73254]:         </nova:port>
Aug 14 15:37:17 user nova-compute[73254]:       </nova:ports>
Aug 14 15:37:17 user nova-compute[73254]:     </nova:instance>
Aug 14 15:37:17 user nova-compute[73254]:   </metadata>
Aug 14 15:37:17 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:37:17 user nova-compute[73254]:     <system>
Aug 14 15:37:17 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:37:17 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:37:17 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:37:17 user nova-compute[73254]:       <entry name="serial">a205ec03-7e16-43fb-be78-8a081027604c</entry>
Aug 14 15:37:17 user nova-compute[73254]:       <entry name="uuid">a205ec03-7e16-43fb-be78-8a081027604c</entry>
Aug 14 15:37:17 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:37:17 user nova-compute[73254]:     </system>
Aug 14 15:37:17 user nova-compute[73254]:   </sysinfo>
Aug 14 15:37:17 user nova-compute[73254]:   <os>
Aug 14 15:37:17 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:37:17 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:37:17 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:37:17 user nova-compute[73254]:   </os>
Aug 14 15:37:17 user nova-compute[73254]:   <features>
Aug 14 15:37:17 user nova-compute[73254]:     <acpi/>
Aug 14 15:37:17 user nova-compute[73254]:     <apic/>
Aug 14 15:37:17 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:37:17 user nova-compute[73254]:   </features>
Aug 14 15:37:17 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:37:17 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:37:17 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:37:17 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:37:17 user nova-compute[73254]:   </clock>
Aug 14 15:37:17 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:37:17 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:37:17 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:37:17 user nova-compute[73254]:   </cpu>
Aug 14 15:37:17 user nova-compute[73254]:   <devices>
Aug 14 15:37:17 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:37:17 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:37:17 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk"/>
Aug 14 15:37:17 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:37:17 user nova-compute[73254]:     </disk>
Aug 14 15:37:17 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:37:17 user nova-compute[73254]:       <mac address="fa:16:3e:75:bb:69"/>
Aug 14 15:37:17 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:37:17 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:37:17 user nova-compute[73254]:       <target dev="tap96535eb7-98"/>
Aug 14 15:37:17 user nova-compute[73254]:     </interface>
Aug 14 15:37:17 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:37:17 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/console.log" append="off"/>
Aug 14 15:37:17 user nova-compute[73254]:     </serial>
Aug 14 15:37:17 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:37:17 user nova-compute[73254]:     <video>
Aug 14 15:37:17 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:37:17 user nova-compute[73254]:     </video>
Aug 14 15:37:17 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:37:17 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:37:17 user nova-compute[73254]:     </rng>
Aug 14 15:37:17 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:37:17 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:37:17 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:37:17 user nova-compute[73254]:     </memballoon>
Aug 14 15:37:17 user nova-compute[73254]:   </devices>
Aug 14 15:37:17 user nova-compute[73254]: </domain>
Aug 14 15:37:17 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:37:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-331854924',display_name='tempest-VolumesActionsTest-instance-331854924',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-331854924',id=45,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97bc3c8780fa4bf4a81079668aceafa7',ramdisk_id='',reservation_id='r-voscs4ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1721189150',owner_user_name='tempest-VolumesActionsTest-1721189150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:37:16Z,user_data=None,user_id='edcba0e9c0be48c3b44606ac81c69334',uuid=a205ec03-7e16-43fb-be78-8a081027604c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converting VIF {"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:bb:69,bridge_name='br-int',has_traffic_filtering=True,id=96535eb7-9828-46f1-b00c-ddfd5956838f,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96535eb7-98') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG os_vif [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:bb:69,bridge_name='br-int',has_traffic_filtering=True,id=96535eb7-9828-46f1-b00c-ddfd5956838f,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96535eb7-98') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96535eb7-98, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap96535eb7-98, col_values=(('external_ids', {'iface-id': '96535eb7-9828-46f1-b00c-ddfd5956838f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:bb:69', 'vm-uuid': 'a205ec03-7e16-43fb-be78-8a081027604c'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:17 user nova-compute[73254]: INFO os_vif [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:bb:69,bridge_name='br-int',has_traffic_filtering=True,id=96535eb7-9828-46f1-b00c-ddfd5956838f,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96535eb7-98')
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:37:17 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] No VIF found with MAC fa:16:3e:75:bb:69, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:37:18 user nova-compute[73254]: DEBUG nova.network.neutron [req-368eb1c2-e2dd-4e08-a974-06c7fe399451 req-fab58a1d-8363-4d18-b482-d4f5c1b5a113 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Updated VIF entry in instance network info cache for port 96535eb7-9828-46f1-b00c-ddfd5956838f. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:37:18 user nova-compute[73254]: DEBUG nova.network.neutron [req-368eb1c2-e2dd-4e08-a974-06c7fe399451 req-fab58a1d-8363-4d18-b482-d4f5c1b5a113 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Updating instance_info_cache with network_info: [{"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:37:18 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-368eb1c2-e2dd-4e08-a974-06c7fe399451 req-fab58a1d-8363-4d18-b482-d4f5c1b5a113 service nova] Releasing lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:37:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-0a646aeb-51de-423b-bcfc-fa15bd5f0812 req-8763bf77-6e8b-4cf1-952d-6c49fcca61b8 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Received event network-vif-plugged-96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:37:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0a646aeb-51de-423b-bcfc-fa15bd5f0812 req-8763bf77-6e8b-4cf1-952d-6c49fcca61b8 service nova] Acquiring lock "a205ec03-7e16-43fb-be78-8a081027604c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:37:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0a646aeb-51de-423b-bcfc-fa15bd5f0812 req-8763bf77-6e8b-4cf1-952d-6c49fcca61b8 service nova] Lock "a205ec03-7e16-43fb-be78-8a081027604c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:37:19 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0a646aeb-51de-423b-bcfc-fa15bd5f0812 req-8763bf77-6e8b-4cf1-952d-6c49fcca61b8 service nova] Lock "a205ec03-7e16-43fb-be78-8a081027604c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:37:19 user nova-compute[73254]: DEBUG nova.compute.manager [req-0a646aeb-51de-423b-bcfc-fa15bd5f0812 req-8763bf77-6e8b-4cf1-952d-6c49fcca61b8 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] No waiting events found dispatching network-vif-plugged-96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:37:19 user nova-compute[73254]: WARNING nova.compute.manager [req-0a646aeb-51de-423b-bcfc-fa15bd5f0812 req-8763bf77-6e8b-4cf1-952d-6c49fcca61b8 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Received unexpected event network-vif-plugged-96535eb7-9828-46f1-b00c-ddfd5956838f for instance with vm_state building and task_state spawning.
Aug 14 15:37:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692027441.3243558, a205ec03-7e16-43fb-be78-8a081027604c => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:37:21 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] VM Resumed (Lifecycle Event)
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:37:21 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Instance spawned successfully.
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:37:21 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692027441.3268683, a205ec03-7e16-43fb-be78-8a081027604c => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:37:21 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] VM Started (Lifecycle Event)
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:37:21 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:37:21 user nova-compute[73254]: INFO nova.compute.manager [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:37:21 user nova-compute[73254]: INFO nova.compute.manager [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Took 5.96 seconds to build instance.
Aug 14 15:37:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fed28db0-b5bf-4624-b6d6-0855774e7fe2 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "a205ec03-7e16-43fb-be78-8a081027604c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.063s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.compute.manager [req-b8688f32-7ff0-43cd-98ca-4cfb9d9fce2b req-c61602d2-37a9-4f55-afe5-38fa63599790 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Received event network-vif-plugged-96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b8688f32-7ff0-43cd-98ca-4cfb9d9fce2b req-c61602d2-37a9-4f55-afe5-38fa63599790 service nova] Acquiring lock "a205ec03-7e16-43fb-be78-8a081027604c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b8688f32-7ff0-43cd-98ca-4cfb9d9fce2b req-c61602d2-37a9-4f55-afe5-38fa63599790 service nova] Lock "a205ec03-7e16-43fb-be78-8a081027604c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b8688f32-7ff0-43cd-98ca-4cfb9d9fce2b req-c61602d2-37a9-4f55-afe5-38fa63599790 service nova] Lock "a205ec03-7e16-43fb-be78-8a081027604c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:37:21 user nova-compute[73254]: DEBUG nova.compute.manager [req-b8688f32-7ff0-43cd-98ca-4cfb9d9fce2b req-c61602d2-37a9-4f55-afe5-38fa63599790 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] No waiting events found dispatching network-vif-plugged-96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:37:21 user nova-compute[73254]: WARNING nova.compute.manager [req-b8688f32-7ff0-43cd-98ca-4cfb9d9fce2b req-c61602d2-37a9-4f55-afe5-38fa63599790 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Received unexpected event network-vif-plugged-96535eb7-9828-46f1-b00c-ddfd5956838f for instance with vm_state active and task_state None.
Aug 14 15:37:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:24 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:37:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:37:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.008s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:37:24 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:37:24 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:37:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:37:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:37:24 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:37:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:37:25 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:37:25 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:37:25 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8871MB free_disk=25.17977523803711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:37:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:37:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:37:25 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a205ec03-7e16-43fb-be78-8a081027604c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:37:25 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:37:25 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:37:25 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:37:25 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:37:25 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:37:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:37:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:37:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:28 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:37:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid a205ec03-7e16-43fb-be78-8a081027604c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:37:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:37:33 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Updating instance_info_cache with network_info: [{"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:37:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:37:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:37:35 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:37:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:37:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:37:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:37:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:37:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:37:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:38:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:38:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:25 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:38:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:38:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:38:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:38:25 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:38:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:38:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:38:25 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:38:26 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:38:26 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:38:26 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:38:26 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8792MB free_disk=25.151386260986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:38:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:38:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:38:26 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance a205ec03-7e16-43fb-be78-8a081027604c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:38:26 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:38:26 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:38:26 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:38:26 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:38:26 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:38:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:38:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:29 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:38:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:38:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:38:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:38:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:38:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:38:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:38:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:38:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:38:33 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:38:33 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid a205ec03-7e16-43fb-be78-8a081027604c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:38:34 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Updating instance_info_cache with network_info: [{"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:38:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-a205ec03-7e16-43fb-be78-8a081027604c" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:38:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:38:35 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:38:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:38:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:38:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:38:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:38:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:38:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:38:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:38:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:38:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:38:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:38:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:38:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:39:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:39:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:39:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:39:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:39:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "a205ec03-7e16-43fb-be78-8a081027604c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "a205ec03-7e16-43fb-be78-8a081027604c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "a205ec03-7e16-43fb-be78-8a081027604c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "a205ec03-7e16-43fb-be78-8a081027604c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "a205ec03-7e16-43fb-be78-8a081027604c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:06 user nova-compute[73254]: INFO nova.compute.manager [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Terminating instance
Aug 14 15:39:06 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-5885566e-dc7d-4963-a658-a39d05787b3c req-ac6c716b-463a-4f60-87c5-293ec09922b3 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Received event network-vif-unplugged-96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5885566e-dc7d-4963-a658-a39d05787b3c req-ac6c716b-463a-4f60-87c5-293ec09922b3 service nova] Acquiring lock "a205ec03-7e16-43fb-be78-8a081027604c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5885566e-dc7d-4963-a658-a39d05787b3c req-ac6c716b-463a-4f60-87c5-293ec09922b3 service nova] Lock "a205ec03-7e16-43fb-be78-8a081027604c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5885566e-dc7d-4963-a658-a39d05787b3c req-ac6c716b-463a-4f60-87c5-293ec09922b3 service nova] Lock "a205ec03-7e16-43fb-be78-8a081027604c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-5885566e-dc7d-4963-a658-a39d05787b3c req-ac6c716b-463a-4f60-87c5-293ec09922b3 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] No waiting events found dispatching network-vif-unplugged-96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG nova.compute.manager [req-5885566e-dc7d-4963-a658-a39d05787b3c req-ac6c716b-463a-4f60-87c5-293ec09922b3 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Received event network-vif-unplugged-96535eb7-9828-46f1-b00c-ddfd5956838f for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:06 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Instance destroyed successfully.
Aug 14 15:39:06 user nova-compute[73254]: DEBUG nova.objects.instance [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lazy-loading 'resources' on Instance uuid a205ec03-7e16-43fb-be78-8a081027604c {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:37:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-331854924',display_name='tempest-VolumesActionsTest-instance-331854924',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-331854924',id=45,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:37:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97bc3c8780fa4bf4a81079668aceafa7',ramdisk_id='',reservation_id='r-voscs4ek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1721189150',owner_user_name='tempest-VolumesActionsTest-1721189150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:37:21Z,user_data=None,user_id='edcba0e9c0be48c3b44606ac81c69334',uuid=a205ec03-7e16-43fb-be78-8a081027604c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converting VIF {"id": "96535eb7-9828-46f1-b00c-ddfd5956838f", "address": "fa:16:3e:75:bb:69", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96535eb7-98", "ovs_interfaceid": "96535eb7-9828-46f1-b00c-ddfd5956838f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:bb:69,bridge_name='br-int',has_traffic_filtering=True,id=96535eb7-9828-46f1-b00c-ddfd5956838f,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96535eb7-98') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG os_vif [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:bb:69,bridge_name='br-int',has_traffic_filtering=True,id=96535eb7-9828-46f1-b00c-ddfd5956838f,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96535eb7-98') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96535eb7-98, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:39:06 user nova-compute[73254]: INFO os_vif [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:bb:69,bridge_name='br-int',has_traffic_filtering=True,id=96535eb7-9828-46f1-b00c-ddfd5956838f,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96535eb7-98')
Aug 14 15:39:06 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Deleting instance files /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c_del
Aug 14 15:39:06 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Deletion of /opt/stack/data/nova/instances/a205ec03-7e16-43fb-be78-8a081027604c_del complete
Aug 14 15:39:06 user nova-compute[73254]: INFO nova.compute.manager [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 14 15:39:06 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:39:06 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: a205ec03-7e16-43fb-be78-8a081027604c] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:39:07 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:39:07 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Took 0.57 seconds to deallocate network for instance.
Aug 14 15:39:07 user nova-compute[73254]: DEBUG nova.compute.manager [req-47a29a1c-9463-4952-901d-9c98ec0535d2 req-7a18f42d-b164-4053-bccc-f102d6c578db service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Received event network-vif-deleted-96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:39:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:07 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:39:07 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:39:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:07 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Deleted allocations for instance a205ec03-7e16-43fb-be78-8a081027604c
Aug 14 15:39:07 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-3c77cabf-4a11-4876-a2df-9655dbcfbfc4 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "a205ec03-7e16-43fb-be78-8a081027604c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.730s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-e5de1f38-ba03-4605-afbc-6350832a2a34 req-54070aef-7c31-422f-a808-e7b4400e9802 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Received event network-vif-plugged-96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:39:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e5de1f38-ba03-4605-afbc-6350832a2a34 req-54070aef-7c31-422f-a808-e7b4400e9802 service nova] Acquiring lock "a205ec03-7e16-43fb-be78-8a081027604c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e5de1f38-ba03-4605-afbc-6350832a2a34 req-54070aef-7c31-422f-a808-e7b4400e9802 service nova] Lock "a205ec03-7e16-43fb-be78-8a081027604c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e5de1f38-ba03-4605-afbc-6350832a2a34 req-54070aef-7c31-422f-a808-e7b4400e9802 service nova] Lock "a205ec03-7e16-43fb-be78-8a081027604c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:08 user nova-compute[73254]: DEBUG nova.compute.manager [req-e5de1f38-ba03-4605-afbc-6350832a2a34 req-54070aef-7c31-422f-a808-e7b4400e9802 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] No waiting events found dispatching network-vif-plugged-96535eb7-9828-46f1-b00c-ddfd5956838f {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:39:08 user nova-compute[73254]: WARNING nova.compute.manager [req-e5de1f38-ba03-4605-afbc-6350832a2a34 req-54070aef-7c31-422f-a808-e7b4400e9802 service nova] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Received unexpected event network-vif-plugged-96535eb7-9828-46f1-b00c-ddfd5956838f for instance with vm_state deleted and task_state None.
Aug 14 15:39:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:39:19 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:19 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:39:21 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692027546.7967741, a205ec03-7e16-43fb-be78-8a081027604c => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:39:21 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: a205ec03-7e16-43fb-be78-8a081027604c] VM Stopped (Lifecycle Event)
Aug 14 15:39:21 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d01b4119-9031-43bf-ab9b-0eca195df09f None None] [instance: a205ec03-7e16-43fb-be78-8a081027604c] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:39:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:39:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:39:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:39:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:39:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:27 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:27 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:39:28 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:39:28 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:39:28 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=25.178573608398438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:39:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:28 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:39:28 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:39:28 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:39:28 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:39:28 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:39:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:29 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:39:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:39:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:39:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:39:35 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:35 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:39:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:39:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:39:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:39:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:39:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:38 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:41 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:42 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:39:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:39:42 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:39:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:39:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:39:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:39:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:39:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:39:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:39:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "c5ee8725-40ff-4801-81fe-45474c0f00e7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:39:57 user nova-compute[73254]: INFO nova.compute.claims [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Claim successful on node user
Aug 14 15:39:57 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.173s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:39:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:39:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:39:57 user nova-compute[73254]: DEBUG nova.policy [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'edcba0e9c0be48c3b44606ac81c69334', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bc3c8780fa4bf4a81079668aceafa7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:39:58 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Creating image(s)
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "/opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "/opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.178s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.182s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk 1073741824 {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc,backing_fmt=raw /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk 1073741824" returned: 0 in 0.049s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "15000720ae0601f4620e84fffcd9d21aa7a462bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/15000720ae0601f4620e84fffcd9d21aa7a462bc --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk. size=1073741824 {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG nova.virt.disk.api [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Cannot resize image /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk to a smaller size. {{(pid=73254) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lazy-loading 'migration_context' on Instance uuid c5ee8725-40ff-4801-81fe-45474c0f00e7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Created local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Ensure instance console log exists: /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:39:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:39:59 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Successfully created port: cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:39:59 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Successfully updated port: cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:39:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:39:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquired lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:39:59 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:39:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-d7b78532-6118-4c2d-863b-1393e1e171c5 req-8cc7e785-d640-49eb-9944-65b4ff25a77f service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Received event network-changed-cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:39:59 user nova-compute[73254]: DEBUG nova.compute.manager [req-d7b78532-6118-4c2d-863b-1393e1e171c5 req-8cc7e785-d640-49eb-9944-65b4ff25a77f service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Refreshing instance network info cache due to event network-changed-cf0fa10d-ddbd-453a-b5c6-5f485a736844. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:39:59 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d7b78532-6118-4c2d-863b-1393e1e171c5 req-8cc7e785-d640-49eb-9944-65b4ff25a77f service nova] Acquiring lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:39:59 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.network.neutron [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Updating instance_info_cache with network_info: [{"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Releasing lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Instance network_info: |[{"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d7b78532-6118-4c2d-863b-1393e1e171c5 req-8cc7e785-d640-49eb-9944-65b4ff25a77f service nova] Acquired lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.network.neutron [req-d7b78532-6118-4c2d-863b-1393e1e171c5 req-8cc7e785-d640-49eb-9944-65b4ff25a77f service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Refreshing network info cache for port cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Start _get_guest_xml network_info=[{"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_options': None, 'size': 0, 'encrypted': False, 'disk_bus': 'virtio', 'boot_index': 0, 'encryption_secret_uuid': None, 'guest_format': None, 'device_type': 'disk', 'device_name': '/dev/vda', 'encryption_format': None, 'image_id': '5e61edbd-805a-4552-b424-f092693ae8cc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:40:00 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:40:00 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-14T14:54:20Z,direct_url=<?>,disk_format='qcow2',id=5e61edbd-805a-4552-b424-f092693ae8cc,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a8bcb64fb6d84e019592c26b7626e3e0',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-14T14:54:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-185027853',display_name='tempest-VolumesActionsTest-instance-185027853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-185027853',id=46,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97bc3c8780fa4bf4a81079668aceafa7',ramdisk_id='',reservation_id='r-kqm8vbgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1721189150',owner_user_name='tempest-VolumesActionsTest-1721189150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:39:58Z,user_data=None,user_id='edcba0e9c0be48c3b44606ac81c69334',uuid=c5ee8725-40ff-4801-81fe-45474c0f00e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converting VIF {"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=cf0fa10d-ddbd-453a-b5c6-5f485a736844,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0fa10d-dd') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.objects.instance [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lazy-loading 'pci_devices' on Instance uuid c5ee8725-40ff-4801-81fe-45474c0f00e7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:40:00 user nova-compute[73254]:   <uuid>c5ee8725-40ff-4801-81fe-45474c0f00e7</uuid>
Aug 14 15:40:00 user nova-compute[73254]:   <name>instance-0000002e</name>
Aug 14 15:40:00 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:40:00 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:40:00 user nova-compute[73254]:   <metadata>
Aug 14 15:40:00 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:40:00 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:40:00 user nova-compute[73254]:       <nova:name>tempest-VolumesActionsTest-instance-185027853</nova:name>
Aug 14 15:40:00 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:40:00</nova:creationTime>
Aug 14 15:40:00 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:40:00 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:40:00 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:40:00 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:40:00 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:40:00 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:40:00 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:40:00 user nova-compute[73254]:       <nova:owner>
Aug 14 15:40:00 user nova-compute[73254]:         <nova:user uuid="edcba0e9c0be48c3b44606ac81c69334">tempest-VolumesActionsTest-1721189150-project-member</nova:user>
Aug 14 15:40:00 user nova-compute[73254]:         <nova:project uuid="97bc3c8780fa4bf4a81079668aceafa7">tempest-VolumesActionsTest-1721189150</nova:project>
Aug 14 15:40:00 user nova-compute[73254]:       </nova:owner>
Aug 14 15:40:00 user nova-compute[73254]:       <nova:root type="image" uuid="5e61edbd-805a-4552-b424-f092693ae8cc"/>
Aug 14 15:40:00 user nova-compute[73254]:       <nova:ports>
Aug 14 15:40:00 user nova-compute[73254]:         <nova:port uuid="cf0fa10d-ddbd-453a-b5c6-5f485a736844">
Aug 14 15:40:00 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 15:40:00 user nova-compute[73254]:         </nova:port>
Aug 14 15:40:00 user nova-compute[73254]:       </nova:ports>
Aug 14 15:40:00 user nova-compute[73254]:     </nova:instance>
Aug 14 15:40:00 user nova-compute[73254]:   </metadata>
Aug 14 15:40:00 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:40:00 user nova-compute[73254]:     <system>
Aug 14 15:40:00 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:40:00 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:40:00 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:40:00 user nova-compute[73254]:       <entry name="serial">c5ee8725-40ff-4801-81fe-45474c0f00e7</entry>
Aug 14 15:40:00 user nova-compute[73254]:       <entry name="uuid">c5ee8725-40ff-4801-81fe-45474c0f00e7</entry>
Aug 14 15:40:00 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:40:00 user nova-compute[73254]:     </system>
Aug 14 15:40:00 user nova-compute[73254]:   </sysinfo>
Aug 14 15:40:00 user nova-compute[73254]:   <os>
Aug 14 15:40:00 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:40:00 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:40:00 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:40:00 user nova-compute[73254]:   </os>
Aug 14 15:40:00 user nova-compute[73254]:   <features>
Aug 14 15:40:00 user nova-compute[73254]:     <acpi/>
Aug 14 15:40:00 user nova-compute[73254]:     <apic/>
Aug 14 15:40:00 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:40:00 user nova-compute[73254]:   </features>
Aug 14 15:40:00 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:40:00 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:40:00 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:40:00 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:40:00 user nova-compute[73254]:   </clock>
Aug 14 15:40:00 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:40:00 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:40:00 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:40:00 user nova-compute[73254]:   </cpu>
Aug 14 15:40:00 user nova-compute[73254]:   <devices>
Aug 14 15:40:00 user nova-compute[73254]:     <disk type="file" device="disk">
Aug 14 15:40:00 user nova-compute[73254]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 14 15:40:00 user nova-compute[73254]:       <source file="/opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk"/>
Aug 14 15:40:00 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:40:00 user nova-compute[73254]:     </disk>
Aug 14 15:40:00 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:40:00 user nova-compute[73254]:       <mac address="fa:16:3e:7b:c8:05"/>
Aug 14 15:40:00 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:40:00 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:40:00 user nova-compute[73254]:       <target dev="tapcf0fa10d-dd"/>
Aug 14 15:40:00 user nova-compute[73254]:     </interface>
Aug 14 15:40:00 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:40:00 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/console.log" append="off"/>
Aug 14 15:40:00 user nova-compute[73254]:     </serial>
Aug 14 15:40:00 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:40:00 user nova-compute[73254]:     <video>
Aug 14 15:40:00 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:40:00 user nova-compute[73254]:     </video>
Aug 14 15:40:00 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:40:00 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:40:00 user nova-compute[73254]:     </rng>
Aug 14 15:40:00 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:40:00 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:40:00 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:40:00 user nova-compute[73254]:     </memballoon>
Aug 14 15:40:00 user nova-compute[73254]:   </devices>
Aug 14 15:40:00 user nova-compute[73254]: </domain>
Aug 14 15:40:00 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-185027853',display_name='tempest-VolumesActionsTest-instance-185027853',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-185027853',id=46,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='97bc3c8780fa4bf4a81079668aceafa7',ramdisk_id='',reservation_id='r-kqm8vbgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1721189150',owner_user_name='tempest-VolumesActionsTest-1721189150-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:39:58Z,user_data=None,user_id='edcba0e9c0be48c3b44606ac81c69334',uuid=c5ee8725-40ff-4801-81fe-45474c0f00e7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converting VIF {"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=cf0fa10d-ddbd-453a-b5c6-5f485a736844,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0fa10d-dd') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG os_vif [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=cf0fa10d-ddbd-453a-b5c6-5f485a736844,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0fa10d-dd') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf0fa10d-dd, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcf0fa10d-dd, col_values=(('external_ids', {'iface-id': 'cf0fa10d-ddbd-453a-b5c6-5f485a736844', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:c8:05', 'vm-uuid': 'c5ee8725-40ff-4801-81fe-45474c0f00e7'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:00 user nova-compute[73254]: INFO os_vif [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=cf0fa10d-ddbd-453a-b5c6-5f485a736844,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0fa10d-dd')
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] No VIF found with MAC fa:16:3e:7b:c8:05, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.network.neutron [req-d7b78532-6118-4c2d-863b-1393e1e171c5 req-8cc7e785-d640-49eb-9944-65b4ff25a77f service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Updated VIF entry in instance network info cache for port cf0fa10d-ddbd-453a-b5c6-5f485a736844. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG nova.network.neutron [req-d7b78532-6118-4c2d-863b-1393e1e171c5 req-8cc7e785-d640-49eb-9944-65b4ff25a77f service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Updating instance_info_cache with network_info: [{"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:40:00 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d7b78532-6118-4c2d-863b-1393e1e171c5 req-8cc7e785-d640-49eb-9944-65b4ff25a77f service nova] Releasing lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:40:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-6d64b3fc-0351-4056-86a3-abb486482f2b req-acd9da2b-1550-4f42-872a-7cd43a3421e4 service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Received event network-vif-plugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:40:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6d64b3fc-0351-4056-86a3-abb486482f2b req-acd9da2b-1550-4f42-872a-7cd43a3421e4 service nova] Acquiring lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:40:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6d64b3fc-0351-4056-86a3-abb486482f2b req-acd9da2b-1550-4f42-872a-7cd43a3421e4 service nova] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:40:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6d64b3fc-0351-4056-86a3-abb486482f2b req-acd9da2b-1550-4f42-872a-7cd43a3421e4 service nova] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:40:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-6d64b3fc-0351-4056-86a3-abb486482f2b req-acd9da2b-1550-4f42-872a-7cd43a3421e4 service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] No waiting events found dispatching network-vif-plugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:40:01 user nova-compute[73254]: WARNING nova.compute.manager [req-6d64b3fc-0351-4056-86a3-abb486482f2b req-acd9da2b-1550-4f42-872a-7cd43a3421e4 service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Received unexpected event network-vif-plugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 for instance with vm_state building and task_state spawning.
Aug 14 15:40:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692027603.689608, c5ee8725-40ff-4801-81fe-45474c0f00e7 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:40:03 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] VM Resumed (Lifecycle Event)
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:40:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Instance spawned successfully.
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:40:03 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692027603.6908338, c5ee8725-40ff-4801-81fe-45474c0f00e7 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:40:03 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] VM Started (Lifecycle Event)
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:40:03 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:40:03 user nova-compute[73254]: INFO nova.compute.manager [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:40:03 user nova-compute[73254]: INFO nova.compute.manager [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Took 6.25 seconds to build instance.
Aug 14 15:40:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-a44edf81-0371-44fb-ac80-d9650a21219a tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.346s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.compute.manager [req-fc044a02-6b3e-458e-8335-43a83b327ba6 req-53ef15b8-65df-4195-bbe5-033a8d5a62ed service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Received event network-vif-plugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fc044a02-6b3e-458e-8335-43a83b327ba6 req-53ef15b8-65df-4195-bbe5-033a8d5a62ed service nova] Acquiring lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fc044a02-6b3e-458e-8335-43a83b327ba6 req-53ef15b8-65df-4195-bbe5-033a8d5a62ed service nova] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-fc044a02-6b3e-458e-8335-43a83b327ba6 req-53ef15b8-65df-4195-bbe5-033a8d5a62ed service nova] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:40:03 user nova-compute[73254]: DEBUG nova.compute.manager [req-fc044a02-6b3e-458e-8335-43a83b327ba6 req-53ef15b8-65df-4195-bbe5-033a8d5a62ed service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] No waiting events found dispatching network-vif-plugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:40:03 user nova-compute[73254]: WARNING nova.compute.manager [req-fc044a02-6b3e-458e-8335-43a83b327ba6 req-53ef15b8-65df-4195-bbe5-033a8d5a62ed service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Received unexpected event network-vif-plugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 for instance with vm_state active and task_state None.
Aug 14 15:40:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:40:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:40:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:40:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:40:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:28 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:40:29 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:40:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:40:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:40:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:40:29 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:40:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:40:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:40:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:30 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:40:30 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:40:30 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8742MB free_disk=25.149280548095703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c5ee8725-40ff-4801-81fe-45474c0f00e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:40:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:40:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:40:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:40:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:40:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:40:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:40:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:40:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:40:36 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:40:36 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid c5ee8725-40ff-4801-81fe-45474c0f00e7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:40:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Updating instance_info_cache with network_info: [{"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:40:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:40:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:40:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:40:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:40:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:40:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:38 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:40:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:40 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:40:44 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:40:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:40:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:40:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:40:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:40:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:40:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:40:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:40:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:40:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:40:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:40:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:40:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:40:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:40:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:40:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:41:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:41:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:41:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:41:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:41:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:41:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:41:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:41:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:41:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:41:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:41:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:41:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:41:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:41:30 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:41:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:41:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:41:30 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk --force-share --output=json {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:41:31 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:41:31 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=25.14853286743164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance c5ee8725-40ff-4801-81fe-45474c0f00e7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:41:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:41:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:41:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:41:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:41:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:41:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:41:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:41:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:41:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:41:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:41:37 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:41:37 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid c5ee8725-40ff-4801-81fe-45474c0f00e7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:41:38 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Updating instance_info_cache with network_info: [{"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:41:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-c5ee8725-40ff-4801-81fe-45474c0f00e7" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:41:38 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:41:38 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:41:38 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:41:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:41:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:41:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:41:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:42 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:41:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "c5ee8725-40ff-4801-81fe-45474c0f00e7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:41:48 user nova-compute[73254]: INFO nova.compute.manager [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Terminating instance
Aug 14 15:41:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-28daa7be-672d-4a5d-af65-7133c2da39c5 req-f0e5c92e-1be1-4890-beaf-18ef48fa927a service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Received event network-vif-unplugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-28daa7be-672d-4a5d-af65-7133c2da39c5 req-f0e5c92e-1be1-4890-beaf-18ef48fa927a service nova] Acquiring lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-28daa7be-672d-4a5d-af65-7133c2da39c5 req-f0e5c92e-1be1-4890-beaf-18ef48fa927a service nova] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-28daa7be-672d-4a5d-af65-7133c2da39c5 req-f0e5c92e-1be1-4890-beaf-18ef48fa927a service nova] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-28daa7be-672d-4a5d-af65-7133c2da39c5 req-f0e5c92e-1be1-4890-beaf-18ef48fa927a service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] No waiting events found dispatching network-vif-unplugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG nova.compute.manager [req-28daa7be-672d-4a5d-af65-7133c2da39c5 req-f0e5c92e-1be1-4890-beaf-18ef48fa927a service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Received event network-vif-unplugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:41:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Instance destroyed successfully.
Aug 14 15:41:49 user nova-compute[73254]: DEBUG nova.objects.instance [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lazy-loading 'resources' on Instance uuid c5ee8725-40ff-4801-81fe-45474c0f00e7 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-185027853',display_name='tempest-VolumesActionsTest-instance-185027853',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-185027853',id=46,image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:40:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='97bc3c8780fa4bf4a81079668aceafa7',ramdisk_id='',reservation_id='r-kqm8vbgd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e61edbd-805a-4552-b424-f092693ae8cc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1721189150',owner_user_name='tempest-VolumesActionsTest-1721189150-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:40:04Z,user_data=None,user_id='edcba0e9c0be48c3b44606ac81c69334',uuid=c5ee8725-40ff-4801-81fe-45474c0f00e7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converting VIF {"id": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "address": "fa:16:3e:7b:c8:05", "network": {"id": "8f5d68d9-c84a-4059-8fcf-a46fc0e2a856", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1064393149-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "97bc3c8780fa4bf4a81079668aceafa7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf0fa10d-dd", "ovs_interfaceid": "cf0fa10d-ddbd-453a-b5c6-5f485a736844", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=cf0fa10d-ddbd-453a-b5c6-5f485a736844,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0fa10d-dd') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG os_vif [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=cf0fa10d-ddbd-453a-b5c6-5f485a736844,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0fa10d-dd') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf0fa10d-dd, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:41:49 user nova-compute[73254]: INFO os_vif [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:c8:05,bridge_name='br-int',has_traffic_filtering=True,id=cf0fa10d-ddbd-453a-b5c6-5f485a736844,network=Network(8f5d68d9-c84a-4059-8fcf-a46fc0e2a856),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf0fa10d-dd')
Aug 14 15:41:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Deleting instance files /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7_del
Aug 14 15:41:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Deletion of /opt/stack/data/nova/instances/c5ee8725-40ff-4801-81fe-45474c0f00e7_del complete
Aug 14 15:41:49 user nova-compute[73254]: INFO nova.compute.manager [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 14 15:41:49 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:41:49 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Took 0.51 seconds to deallocate network for instance.
Aug 14 15:41:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-79c75d8a-e3d0-46f2-8dba-6cacd683cb43 req-7d29d07e-cff1-4e2e-9df6-728cd40f7825 service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Received event network-vif-deleted-cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:41:49 user nova-compute[73254]: INFO nova.compute.manager [req-79c75d8a-e3d0-46f2-8dba-6cacd683cb43 req-7d29d07e-cff1-4e2e-9df6-728cd40f7825 service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Neutron deleted interface cf0fa10d-ddbd-453a-b5c6-5f485a736844; detaching it from the instance and deleting it from the info cache
Aug 14 15:41:49 user nova-compute[73254]: DEBUG nova.network.neutron [req-79c75d8a-e3d0-46f2-8dba-6cacd683cb43 req-7d29d07e-cff1-4e2e-9df6-728cd40f7825 service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG nova.compute.manager [req-79c75d8a-e3d0-46f2-8dba-6cacd683cb43 req-7d29d07e-cff1-4e2e-9df6-728cd40f7825 service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Detach interface failed, port_id=cf0fa10d-ddbd-453a-b5c6-5f485a736844, reason: Instance c5ee8725-40ff-4801-81fe-45474c0f00e7 could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:41:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:41:50 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:41:50 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:41:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:41:50 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Deleted allocations for instance c5ee8725-40ff-4801-81fe-45474c0f00e7
Aug 14 15:41:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-89591f19-f20b-4e85-8a1c-085f9ff858e8 tempest-VolumesActionsTest-1721189150 tempest-VolumesActionsTest-1721189150-project-member] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.688s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:41:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5d18952e-0f38-45ef-a477-0675c1fe4bf4 req-c9b95b91-5d24-40fb-9aa0-dea99bf62cc6 service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Received event network-vif-plugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:41:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5d18952e-0f38-45ef-a477-0675c1fe4bf4 req-c9b95b91-5d24-40fb-9aa0-dea99bf62cc6 service nova] Acquiring lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:41:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5d18952e-0f38-45ef-a477-0675c1fe4bf4 req-c9b95b91-5d24-40fb-9aa0-dea99bf62cc6 service nova] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:41:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5d18952e-0f38-45ef-a477-0675c1fe4bf4 req-c9b95b91-5d24-40fb-9aa0-dea99bf62cc6 service nova] Lock "c5ee8725-40ff-4801-81fe-45474c0f00e7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:41:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-5d18952e-0f38-45ef-a477-0675c1fe4bf4 req-c9b95b91-5d24-40fb-9aa0-dea99bf62cc6 service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] No waiting events found dispatching network-vif-plugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:41:50 user nova-compute[73254]: WARNING nova.compute.manager [req-5d18952e-0f38-45ef-a477-0675c1fe4bf4 req-c9b95b91-5d24-40fb-9aa0-dea99bf62cc6 service nova] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Received unexpected event network-vif-plugged-cf0fa10d-ddbd-453a-b5c6-5f485a736844 for instance with vm_state deleted and task_state None.
Aug 14 15:41:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:41:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:42:04 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692027709.2606077, c5ee8725-40ff-4801-81fe-45474c0f00e7 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:42:04 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] VM Stopped (Lifecycle Event)
Aug 14 15:42:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-76746a2a-15bf-42b0-9e23-b1e6f40ac2b7 None None] [instance: c5ee8725-40ff-4801-81fe-45474c0f00e7] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:42:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:42:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:42:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:42:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:42:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:42:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:42:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:42:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:42:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:42:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:42:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:42:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:42:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:42:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:42:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:42:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:42:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:42:32 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:42:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:42:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:42:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:42:32 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:42:32 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:42:32 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:42:32 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=25.175697326660156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:42:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:42:32 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:42:33 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:42:33 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:42:33 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:42:33 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:42:33 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:42:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:42:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:42:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:42:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:42:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:42:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:42:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:42:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:42:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:42:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:42:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:42:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:42:40 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:42:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:42:44 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:42:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:42:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:42:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:42:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:43:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:43:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:43:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:43:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:43:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:43:34 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:43:35 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:43:35 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:43:35 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=25.173458099365234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:43:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:43:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:43:35 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:43:35 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:43:35 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:43:35 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:43:35 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:43:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:43:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:43:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:43:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:43:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:43:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:43:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:43:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:43:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:43:42 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:43:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:43:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "f9d902b3-65c4-4cd6-a62f-a314778977ae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:43:48 user nova-compute[73254]: INFO nova.compute.claims [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Claim successful on node user
Aug 14 15:43:48 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.187s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:43:48 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:43:49 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:43:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:43:49 user nova-compute[73254]: INFO nova.virt.block_device [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Booting with volume snapshot 2e919fc1-abc9-4f30-a33f-6830b2c54888 at /dev/vda
Aug 14 15:43:49 user nova-compute[73254]: DEBUG nova.policy [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1121a299350a43539a236db2eee5144f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f37aabc603240cfa2fe9c4ee4ec74e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:43:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:49 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Successfully created port: ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:43:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Successfully updated port: ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:43:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "refresh_cache-f9d902b3-65c4-4cd6-a62f-a314778977ae" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:43:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquired lock "refresh_cache-f9d902b3-65c4-4cd6-a62f-a314778977ae" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:43:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:43:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:43:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-e3addfbe-0bb6-48b5-b44c-5744712a9a59 req-f7a40e37-0c14-4417-8029-12432ac3e324 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Received event network-changed-ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:43:50 user nova-compute[73254]: DEBUG nova.compute.manager [req-e3addfbe-0bb6-48b5-b44c-5744712a9a59 req-f7a40e37-0c14-4417-8029-12432ac3e324 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Refreshing instance network info cache due to event network-changed-ee75a164-b4f2-4a6f-bcd9-16ab0172162d. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:43:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e3addfbe-0bb6-48b5-b44c-5744712a9a59 req-f7a40e37-0c14-4417-8029-12432ac3e324 service nova] Acquiring lock "refresh_cache-f9d902b3-65c4-4cd6-a62f-a314778977ae" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:43:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Updating instance_info_cache with network_info: [{"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:43:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Releasing lock "refresh_cache-f9d902b3-65c4-4cd6-a62f-a314778977ae" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:43:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Instance network_info: |[{"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:43:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e3addfbe-0bb6-48b5-b44c-5744712a9a59 req-f7a40e37-0c14-4417-8029-12432ac3e324 service nova] Acquired lock "refresh_cache-f9d902b3-65c4-4cd6-a62f-a314778977ae" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:43:51 user nova-compute[73254]: DEBUG nova.network.neutron [req-e3addfbe-0bb6-48b5-b44c-5744712a9a59 req-f7a40e37-0c14-4417-8029-12432ac3e324 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Refreshing network info cache for port ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:43:52 user nova-compute[73254]: DEBUG nova.network.neutron [req-e3addfbe-0bb6-48b5-b44c-5744712a9a59 req-f7a40e37-0c14-4417-8029-12432ac3e324 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Updated VIF entry in instance network info cache for port ee75a164-b4f2-4a6f-bcd9-16ab0172162d. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:43:52 user nova-compute[73254]: DEBUG nova.network.neutron [req-e3addfbe-0bb6-48b5-b44c-5744712a9a59 req-f7a40e37-0c14-4417-8029-12432ac3e324 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Updating instance_info_cache with network_info: [{"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:43:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e3addfbe-0bb6-48b5-b44c-5744712a9a59 req-f7a40e37-0c14-4417-8029-12432ac3e324 service nova] Releasing lock "refresh_cache-f9d902b3-65c4-4cd6-a62f-a314778977ae" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG os_brick.utils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8ca958-b45f-4bf4-9caa-6d3a02e99277]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fce38c9-6ce3-4ea9-8507-8864677414b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2995c2-1c06-4c21-8a16-c39b8465dba6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[521b1836-2592-4332-8f86-6a76f1b7ef4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:43:54 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:43:54 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ab0d32-4d62-4c08-aa78-291869c50d0d]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG os_brick.utils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:43:54 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Updating existing volume attachment record: 7b3dc27b-9a68-40ae-b1e4-38817573c913 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:43:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:43:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:44:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Creating image(s)
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Ensure instance console log exists: /opt/stack/data/nova/instances/f9d902b3-65c4-4cd6-a62f-a314778977ae/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Start _get_guest_xml network_info=[{"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7b3dc27b-9a68-40ae-b1e4-38817573c913', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgmkspIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f9d902b3-65c4-4cd6-a62f-a314778977ae', 'attached_at': '', 'detached_at': '', 'volume_id': '2be9884b-57ba-4a68-9827-e33e9de19a8f', 'serial': '2be9884b-57ba-4a68-9827-e33e9de19a8f'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:44:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:44:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgmkspIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:44:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:44:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:44:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:44:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:44:08 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[df277b9b-8e9b-4f6a-ba2c-030e1034385a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:44:08 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ecc7bb-7ec8-45da-b28f-9f0e96df050f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f] added
Aug 14 15:44:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dde7cb0-6fc8-43bd-a200-a99a59acace9]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[218b0344-2759-4ded-b45b-b1aae05194fb]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgmkspIa {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hgmkspIa" returned: 0 in 0.028s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d8d488-85c1-4791-988a-494438c2df59]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hgmkspIa'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4c7289-0359-484b-ba75-ad4a9b7c4746]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb59ce7e-369d-4c36-b7c0-d83a5140919c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:44:09 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:44:09 user nova-compute[73254]:  {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:44:09 user nova-compute[73254]: WARNING os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 15:44:09 user nova-compute[73254]: 
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ecda27-d103-4108-9b4a-2a7587ff07dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f, portal: 172.16.0.220,3260]
Aug 14 15:44:09 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f, portal: 172.16.0.220,3260] successful.
Aug 14 15:44:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe26a1d3-d9c9-4bd1-af4f-0c751cc7e188]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9065236-7174-4950-82d8-e9945852b43d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f (non-flash)
Aug 14 15:44:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f (non-flash)
Aug 14 15:44:09 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d765bf-b35f-43d1-9579-f2102802288b]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:44:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgmkspIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23036343436666163', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036343436666163', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1341376943',display_name='tempest-TestVolumeBootPattern-server-1341376943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1341376943',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-izcndxqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:43:49Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=f9d902b3-65c4-4cd6-a62f-a314778977ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:91:82,bridge_name='br-int',has_traffic_filtering=True,id=ee75a164-b4f2-4a6f-bcd9-16ab0172162d,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee75a164-b4') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.objects.instance [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'pci_devices' on Instance uuid f9d902b3-65c4-4cd6-a62f-a314778977ae {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:44:10 user nova-compute[73254]:   <uuid>f9d902b3-65c4-4cd6-a62f-a314778977ae</uuid>
Aug 14 15:44:10 user nova-compute[73254]:   <name>instance-0000002f</name>
Aug 14 15:44:10 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:44:10 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:44:10 user nova-compute[73254]:   <metadata>
Aug 14 15:44:10 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:44:10 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:44:10 user nova-compute[73254]:       <nova:name>tempest-TestVolumeBootPattern-server-1341376943</nova:name>
Aug 14 15:44:10 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:44:08</nova:creationTime>
Aug 14 15:44:10 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:44:10 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:44:10 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:44:10 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:44:10 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:44:10 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:44:10 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:44:10 user nova-compute[73254]:       <nova:owner>
Aug 14 15:44:10 user nova-compute[73254]:         <nova:user uuid="1121a299350a43539a236db2eee5144f">tempest-TestVolumeBootPattern-428038303-project-member</nova:user>
Aug 14 15:44:10 user nova-compute[73254]:         <nova:project uuid="2f37aabc603240cfa2fe9c4ee4ec74e8">tempest-TestVolumeBootPattern-428038303</nova:project>
Aug 14 15:44:10 user nova-compute[73254]:       </nova:owner>
Aug 14 15:44:10 user nova-compute[73254]:       <nova:ports>
Aug 14 15:44:10 user nova-compute[73254]:         <nova:port uuid="ee75a164-b4f2-4a6f-bcd9-16ab0172162d">
Aug 14 15:44:10 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 14 15:44:10 user nova-compute[73254]:         </nova:port>
Aug 14 15:44:10 user nova-compute[73254]:       </nova:ports>
Aug 14 15:44:10 user nova-compute[73254]:     </nova:instance>
Aug 14 15:44:10 user nova-compute[73254]:   </metadata>
Aug 14 15:44:10 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:44:10 user nova-compute[73254]:     <system>
Aug 14 15:44:10 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:44:10 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:44:10 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:44:10 user nova-compute[73254]:       <entry name="serial">f9d902b3-65c4-4cd6-a62f-a314778977ae</entry>
Aug 14 15:44:10 user nova-compute[73254]:       <entry name="uuid">f9d902b3-65c4-4cd6-a62f-a314778977ae</entry>
Aug 14 15:44:10 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:44:10 user nova-compute[73254]:     </system>
Aug 14 15:44:10 user nova-compute[73254]:   </sysinfo>
Aug 14 15:44:10 user nova-compute[73254]:   <os>
Aug 14 15:44:10 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:44:10 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:44:10 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:44:10 user nova-compute[73254]:   </os>
Aug 14 15:44:10 user nova-compute[73254]:   <features>
Aug 14 15:44:10 user nova-compute[73254]:     <acpi/>
Aug 14 15:44:10 user nova-compute[73254]:     <apic/>
Aug 14 15:44:10 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:44:10 user nova-compute[73254]:   </features>
Aug 14 15:44:10 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:44:10 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:44:10 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:44:10 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:44:10 user nova-compute[73254]:   </clock>
Aug 14 15:44:10 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:44:10 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:44:10 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:44:10 user nova-compute[73254]:   </cpu>
Aug 14 15:44:10 user nova-compute[73254]:   <devices>
Aug 14 15:44:10 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:44:10 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:44:10 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 15:44:10 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:44:10 user nova-compute[73254]:       <serial>2be9884b-57ba-4a68-9827-e33e9de19a8f</serial>
Aug 14 15:44:10 user nova-compute[73254]:     </disk>
Aug 14 15:44:10 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:44:10 user nova-compute[73254]:       <mac address="fa:16:3e:53:91:82"/>
Aug 14 15:44:10 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:44:10 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:44:10 user nova-compute[73254]:       <target dev="tapee75a164-b4"/>
Aug 14 15:44:10 user nova-compute[73254]:     </interface>
Aug 14 15:44:10 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:44:10 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/f9d902b3-65c4-4cd6-a62f-a314778977ae/console.log" append="off"/>
Aug 14 15:44:10 user nova-compute[73254]:     </serial>
Aug 14 15:44:10 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:44:10 user nova-compute[73254]:     <video>
Aug 14 15:44:10 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:44:10 user nova-compute[73254]:     </video>
Aug 14 15:44:10 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:44:10 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:44:10 user nova-compute[73254]:     </rng>
Aug 14 15:44:10 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:44:10 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:44:10 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:44:10 user nova-compute[73254]:     </memballoon>
Aug 14 15:44:10 user nova-compute[73254]:   </devices>
Aug 14 15:44:10 user nova-compute[73254]: </domain>
Aug 14 15:44:10 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1341376943',display_name='tempest-TestVolumeBootPattern-server-1341376943',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1341376943',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-izcndxqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:43:49Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=f9d902b3-65c4-4cd6-a62f-a314778977ae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:91:82,bridge_name='br-int',has_traffic_filtering=True,id=ee75a164-b4f2-4a6f-bcd9-16ab0172162d,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee75a164-b4') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG os_vif [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:91:82,bridge_name='br-int',has_traffic_filtering=True,id=ee75a164-b4f2-4a6f-bcd9-16ab0172162d,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee75a164-b4') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapee75a164-b4, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapee75a164-b4, col_values=(('external_ids', {'iface-id': 'ee75a164-b4f2-4a6f-bcd9-16ab0172162d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:91:82', 'vm-uuid': 'f9d902b3-65c4-4cd6-a62f-a314778977ae'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:10 user nova-compute[73254]: INFO os_vif [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:91:82,bridge_name='br-int',has_traffic_filtering=True,id=ee75a164-b4f2-4a6f-bcd9-16ab0172162d,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee75a164-b4')
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:44:10 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No VIF found with MAC fa:16:3e:53:91:82, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:44:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-9786ff60-7030-49d6-ba0f-6cc7e60c0506 req-0cdb1f27-a3f5-49de-a098-2ac866b0fa77 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Received event network-vif-plugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:44:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9786ff60-7030-49d6-ba0f-6cc7e60c0506 req-0cdb1f27-a3f5-49de-a098-2ac866b0fa77 service nova] Acquiring lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:44:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9786ff60-7030-49d6-ba0f-6cc7e60c0506 req-0cdb1f27-a3f5-49de-a098-2ac866b0fa77 service nova] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:44:11 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9786ff60-7030-49d6-ba0f-6cc7e60c0506 req-0cdb1f27-a3f5-49de-a098-2ac866b0fa77 service nova] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:44:11 user nova-compute[73254]: DEBUG nova.compute.manager [req-9786ff60-7030-49d6-ba0f-6cc7e60c0506 req-0cdb1f27-a3f5-49de-a098-2ac866b0fa77 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] No waiting events found dispatching network-vif-plugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:44:11 user nova-compute[73254]: WARNING nova.compute.manager [req-9786ff60-7030-49d6-ba0f-6cc7e60c0506 req-0cdb1f27-a3f5-49de-a098-2ac866b0fa77 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Received unexpected event network-vif-plugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d for instance with vm_state building and task_state spawning.
Aug 14 15:44:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692027853.6796017, f9d902b3-65c4-4cd6-a62f-a314778977ae => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:44:13 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] VM Resumed (Lifecycle Event)
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:44:13 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Instance spawned successfully.
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:44:13 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692027853.68091, f9d902b3-65c4-4cd6-a62f-a314778977ae => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:44:13 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] VM Started (Lifecycle Event)
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:44:13 user nova-compute[73254]: INFO nova.compute.manager [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Took 5.02 seconds to spawn the instance on the hypervisor.
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.compute.manager [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:44:13 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-6bb40038-fea6-4176-9561-e3a4e1404a12 req-9d89ed24-0eb8-4e5c-bb62-4cac9844771d service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Received event network-vif-plugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6bb40038-fea6-4176-9561-e3a4e1404a12 req-9d89ed24-0eb8-4e5c-bb62-4cac9844771d service nova] Acquiring lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6bb40038-fea6-4176-9561-e3a4e1404a12 req-9d89ed24-0eb8-4e5c-bb62-4cac9844771d service nova] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6bb40038-fea6-4176-9561-e3a4e1404a12 req-9d89ed24-0eb8-4e5c-bb62-4cac9844771d service nova] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:44:13 user nova-compute[73254]: DEBUG nova.compute.manager [req-6bb40038-fea6-4176-9561-e3a4e1404a12 req-9d89ed24-0eb8-4e5c-bb62-4cac9844771d service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] No waiting events found dispatching network-vif-plugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:44:13 user nova-compute[73254]: WARNING nova.compute.manager [req-6bb40038-fea6-4176-9561-e3a4e1404a12 req-9d89ed24-0eb8-4e5c-bb62-4cac9844771d service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Received unexpected event network-vif-plugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d for instance with vm_state building and task_state spawning.
Aug 14 15:44:13 user nova-compute[73254]: INFO nova.compute.manager [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Took 25.22 seconds to build instance.
Aug 14 15:44:13 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-bac64e39-74d8-4b11-8e4f-c1c1b39dc6de tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.321s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:44:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:30 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:30 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:44:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:44:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:44:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:44:34 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:44:34 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:44:35 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:44:35 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:44:35 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8730MB free_disk=25.163738250732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:44:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:44:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:44:35 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance f9d902b3-65c4-4cd6-a62f-a314778977ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:44:35 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:44:35 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:44:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:35 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:44:35 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:44:35 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:44:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.293s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:44:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:38 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:44:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:44:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-f9d902b3-65c4-4cd6-a62f-a314778977ae" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:44:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-f9d902b3-65c4-4cd6-a62f-a314778977ae" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:44:39 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:44:39 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid f9d902b3-65c4-4cd6-a62f-a314778977ae {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:44:40 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Updating instance_info_cache with network_info: [{"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:44:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-f9d902b3-65c4-4cd6-a62f-a314778977ae" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:44:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:44:40 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:44:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:40 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:43 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:46 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:44:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:44:47 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:44:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:44:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:45:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:45:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:45:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:45:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:45:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:45:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:45:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:45:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:45:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:45:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:45:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:45:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:45:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:31 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:45:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:45:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:45:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:45:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:45:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:45:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:45:36 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:45:36 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:45:37 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:45:37 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:45:37 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.16318130493164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance f9d902b3-65c4-4cd6-a62f-a314778977ae actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid f9d902b3-65c4-4cd6-a62f-a314778977ae {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "f9d902b3-65c4-4cd6-a62f-a314778977ae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:45:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:45:38 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "f9d902b3-65c4-4cd6-a62f-a314778977ae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:45:39 user nova-compute[73254]: INFO nova.compute.manager [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Terminating instance
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-46ffa083-3af7-4376-aa42-7fb09e96d2b1 req-dcae2566-0c66-4717-aecc-45ebd3b88180 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Received event network-vif-unplugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-46ffa083-3af7-4376-aa42-7fb09e96d2b1 req-dcae2566-0c66-4717-aecc-45ebd3b88180 service nova] Acquiring lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-46ffa083-3af7-4376-aa42-7fb09e96d2b1 req-dcae2566-0c66-4717-aecc-45ebd3b88180 service nova] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-46ffa083-3af7-4376-aa42-7fb09e96d2b1 req-dcae2566-0c66-4717-aecc-45ebd3b88180 service nova] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-46ffa083-3af7-4376-aa42-7fb09e96d2b1 req-dcae2566-0c66-4717-aecc-45ebd3b88180 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] No waiting events found dispatching network-vif-unplugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-46ffa083-3af7-4376-aa42-7fb09e96d2b1 req-dcae2566-0c66-4717-aecc-45ebd3b88180 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Received event network-vif-unplugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Skipping network cache update for instance because it is being deleted. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:45:39 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Instance destroyed successfully.
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'resources' on Instance uuid f9d902b3-65c4-4cd6-a62f-a314778977ae {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1341376943',display_name='tempest-TestVolumeBootPattern-server-1341376943',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1341376943',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:44:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-izcndxqd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:44:14Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=f9d902b3-65c4-4cd6-a62f-a314778977ae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "address": "fa:16:3e:53:91:82", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee75a164-b4", "ovs_interfaceid": "ee75a164-b4f2-4a6f-bcd9-16ab0172162d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:91:82,bridge_name='br-int',has_traffic_filtering=True,id=ee75a164-b4f2-4a6f-bcd9-16ab0172162d,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee75a164-b4') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:45:39 user nova-compute[73254]: DEBUG os_vif [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:91:82,bridge_name='br-int',has_traffic_filtering=True,id=ee75a164-b4f2-4a6f-bcd9-16ab0172162d,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee75a164-b4') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee75a164-b4, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:45:40 user nova-compute[73254]: INFO os_vif [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:91:82,bridge_name='br-int',has_traffic_filtering=True,id=ee75a164-b4f2-4a6f-bcd9-16ab0172162d,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapee75a164-b4')
Aug 14 15:45:40 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hgmkspIa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:45:40 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[423f1699-d65b-41e2-b4ac-114a73c811a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcab0d8-0e8a-483d-94d4-e7cde5518d45]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f (non-flash)
Aug 14 15:45:40 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f (non-flash)
Aug 14 15:45:40 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6685525f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[96223646-de85-4752-810d-90e5d8915a75]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6dd7c3-859f-453d-b6c0-211d14856cdf]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5447348a-edaa-427e-8cb9-d369bf0fd20e]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf9b709-7132-4ede-90e4-fa3c2a092f7f]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f292ce1e-916e-40ae-9c4d-c418a63936d4]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[33338dab-d00e-44e9-b823-25ba4b231fa3]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f, portal: 172.16.0.220,3260]
Aug 14 15:45:40 user nova-compute[73254]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f, portal: 172.16.0.220,3260] successful.
Aug 14 15:45:40 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2be9884b-57ba-4a68-9827-e33e9de19a8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9746451-5bb0-4e07-8edf-d406915ab708]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== disconnect_volume: return (284ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:45:40 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Deleting instance files /opt/stack/data/nova/instances/f9d902b3-65c4-4cd6-a62f-a314778977ae_del
Aug 14 15:45:40 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Deletion of /opt/stack/data/nova/instances/f9d902b3-65c4-4cd6-a62f-a314778977ae_del complete
Aug 14 15:45:40 user nova-compute[73254]: INFO nova.compute.manager [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:45:40 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Took 0.55 seconds to deallocate network for instance.
Aug 14 15:45:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-66d2f8f2-9b3c-48da-8e04-e27b4703c5a4 req-705afb37-6180-460b-953b-0e716e90d7d4 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Received event network-vif-deleted-ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:45:40 user nova-compute[73254]: INFO nova.compute.manager [req-66d2f8f2-9b3c-48da-8e04-e27b4703c5a4 req-705afb37-6180-460b-953b-0e716e90d7d4 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Neutron deleted interface ee75a164-b4f2-4a6f-bcd9-16ab0172162d; detaching it from the instance and deleting it from the info cache
Aug 14 15:45:40 user nova-compute[73254]: DEBUG nova.network.neutron [req-66d2f8f2-9b3c-48da-8e04-e27b4703c5a4 req-705afb37-6180-460b-953b-0e716e90d7d4 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:45:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-66d2f8f2-9b3c-48da-8e04-e27b4703c5a4 req-705afb37-6180-460b-953b-0e716e90d7d4 service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Detach interface failed, port_id=ee75a164-b4f2-4a6f-bcd9-16ab0172162d, reason: Instance f9d902b3-65c4-4cd6-a62f-a314778977ae could not be found. {{(pid=73254) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 14 15:45:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-59764119-2b43-48ce-b8aa-de066095bfc0 req-d753b177-3719-45fb-8bd0-4d98cf2c0b7b service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Received event network-vif-plugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:45:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-59764119-2b43-48ce-b8aa-de066095bfc0 req-d753b177-3719-45fb-8bd0-4d98cf2c0b7b service nova] Acquiring lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:45:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-59764119-2b43-48ce-b8aa-de066095bfc0 req-d753b177-3719-45fb-8bd0-4d98cf2c0b7b service nova] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:45:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-59764119-2b43-48ce-b8aa-de066095bfc0 req-d753b177-3719-45fb-8bd0-4d98cf2c0b7b service nova] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:45:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-59764119-2b43-48ce-b8aa-de066095bfc0 req-d753b177-3719-45fb-8bd0-4d98cf2c0b7b service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] No waiting events found dispatching network-vif-plugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:45:41 user nova-compute[73254]: WARNING nova.compute.manager [req-59764119-2b43-48ce-b8aa-de066095bfc0 req-d753b177-3719-45fb-8bd0-4d98cf2c0b7b service nova] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Received unexpected event network-vif-plugged-ee75a164-b4f2-4a6f-bcd9-16ab0172162d for instance with vm_state active and task_state deleting.
Aug 14 15:45:41 user nova-compute[73254]: INFO nova.compute.manager [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Took 0.75 seconds to detach 1 volumes for instance.
Aug 14 15:45:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Deleting volume: 2be9884b-57ba-4a68-9827-e33e9de19a8f {{(pid=73254) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 15:45:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:45:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:45:41 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:45:41 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:45:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:45:41 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Deleted allocations for instance f9d902b3-65c4-4cd6-a62f-a314778977ae
Aug 14 15:45:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1059fd4d-c0d3-40b1-956f-b819ae8c7220 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "f9d902b3-65c4-4cd6-a62f-a314778977ae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.842s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:45:44 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:45:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:48 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:45:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:45:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:45:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:45:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:45:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:45:54 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692027939.962975, f9d902b3-65c4-4cd6-a62f-a314778977ae => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:45:54 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] VM Stopped (Lifecycle Event)
Aug 14 15:45:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-8cbde5ff-3c51-4207-aaf9-f9521cbd48aa None None] [instance: f9d902b3-65c4-4cd6-a62f-a314778977ae] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:45:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:46:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:46:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:46:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:46:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:46:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:46:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:46:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:46:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:46:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:46:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:46:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:46:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:46:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:46:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:46:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:46:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:46:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:46:33 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:46:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:46:36 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:46:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:46:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:46:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:46:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:46:37 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:46:37 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:46:37 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8947MB free_disk=25.162281036376953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:46:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:46:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:46:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:46:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:46:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:46:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:46:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:46:40 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:46:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:46:42 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:46:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:46:46 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:46:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:46:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:46:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:46:50 user nova-compute[73254]: INFO nova.compute.claims [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Claim successful on node user
Aug 14 15:46:50 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:46:50 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:46:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:46:50 user nova-compute[73254]: INFO nova.virt.block_device [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Booting with volume 09c5214b-8d6e-4742-a63f-7f7c1d749c9f at /dev/vda
Aug 14 15:46:50 user nova-compute[73254]: DEBUG nova.policy [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1121a299350a43539a236db2eee5144f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f37aabc603240cfa2fe9c4ee4ec74e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG os_brick.utils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a7e2c0-7149-47be-88e1-41f306ae4d18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c88af1-bb7d-46fd-a326-bbddf53ffc9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[039a3fe1-b60e-42a1-bacb-497bf13125f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[845ace35-caad-441f-a749-ad736d96505a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:46:50 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:46:50 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f918708-0d8c-4efe-a97b-5ac84d8953ea]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG os_brick.utils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:46:50 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updating existing volume attachment record: 6ce1afc8-491a-4829-a6a0-18a9a974c795 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:46:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Successfully created port: 3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:46:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Successfully updated port: 3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:46:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:46:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquired lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:46:51 user nova-compute[73254]: DEBUG nova.network.neutron [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-90d809ff-3b75-4c65-8b5f-eaaf787cd8aa req-27438e97-0c0c-484d-9c4e-4e2eda083123 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received event network-changed-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG nova.compute.manager [req-90d809ff-3b75-4c65-8b5f-eaaf787cd8aa req-27438e97-0c0c-484d-9c4e-4e2eda083123 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Refreshing instance network info cache due to event network-changed-3ca45e8e-3e6d-4e4f-8b69-05eece009d38. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-90d809ff-3b75-4c65-8b5f-eaaf787cd8aa req-27438e97-0c0c-484d-9c4e-4e2eda083123 service nova] Acquiring lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG nova.network.neutron [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG nova.network.neutron [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updating instance_info_cache with network_info: [{"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Releasing lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Instance network_info: |[{"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-90d809ff-3b75-4c65-8b5f-eaaf787cd8aa req-27438e97-0c0c-484d-9c4e-4e2eda083123 service nova] Acquired lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG nova.network.neutron [req-90d809ff-3b75-4c65-8b5f-eaaf787cd8aa req-27438e97-0c0c-484d-9c4e-4e2eda083123 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Refreshing network info cache for port 3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG nova.network.neutron [req-90d809ff-3b75-4c65-8b5f-eaaf787cd8aa req-27438e97-0c0c-484d-9c4e-4e2eda083123 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updated VIF entry in instance network info cache for port 3ca45e8e-3e6d-4e4f-8b69-05eece009d38. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG nova.network.neutron [req-90d809ff-3b75-4c65-8b5f-eaaf787cd8aa req-27438e97-0c0c-484d-9c4e-4e2eda083123 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updating instance_info_cache with network_info: [{"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:46:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-90d809ff-3b75-4c65-8b5f-eaaf787cd8aa req-27438e97-0c0c-484d-9c4e-4e2eda083123 service nova] Releasing lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:46:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:46:58 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Creating image(s)
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Ensure instance console log exists: /opt/stack/data/nova/instances/ee99b427-804f-4de5-936c-1cd5cb6c5e82/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Start _get_guest_xml network_info=[{"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6ce1afc8-491a-4829-a6a0-18a9a974c795', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJpLuWit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee99b427-804f-4de5-936c-1cd5cb6c5e82', 'attached_at': '', 'detached_at': '', 'volume_id': '09c5214b-8d6e-4742-a63f-7f7c1d749c9f', 'serial': '09c5214b-8d6e-4742-a63f-7f7c1d749c9f'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:46:58 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:46:58 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJpLuWit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:46:58 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:46:58 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:46:58 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9fa8996-aee7-42bb-a8ec-1fb2951b91a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:46:58 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb685aa9-d031-42fa-a70f-34a15f4fdab5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f] added
Aug 14 15:46:58 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[765c7680-ddf5-4ac1-9bcf-92dde473e4f2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[431fc464-ebe7-4539-8b79-db46502ad197]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJpLuWit {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJpLuWit" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7fed77b-6aa5-48f4-8ae9-f60fd10a0580]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fJpLuWit'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f158671-38b9-4436-9698-5807cf5aef62]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd73246c-a417-4d20-bf12-328c008be617]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:46:58 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:46:58 user nova-compute[73254]:  {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:46:58 user nova-compute[73254]: WARNING os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 15:46:58 user nova-compute[73254]: 
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0848ab85-fa35-4bbc-aee7-60dbe0b52532]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f, portal: 172.16.0.220,3260]
Aug 14 15:46:58 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f, portal: 172.16.0.220,3260] successful.
Aug 14 15:46:58 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3364c21-36ec-479f-99a4-4d81f5ba5814]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:46:58 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[68df3be3-facf-432e-9e3f-549b6c909e94]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)
Aug 14 15:46:59 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)
Aug 14 15:46:59 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[de52a7f4-d134-4bc2-baad-9de68324cb9f]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:46:59 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJpLuWit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26462333539376533', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462333539376533', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-575773132',display_name='tempest-TestVolumeBootPattern-volume-backed-server-575773132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-575773132',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGP9sOS2jJNwjsnWx6gXmLjxsw7S+O1pW1bziG7Lw1ClRcfVDp0QyQU5itmbc6+FxrrBbYY8VYJaIm67W7mIjne07jGnDNs3fU7B1E1dZEWfgLqOskH0OC4ZvvgmJjnW7w==',key_name='tempest-keypair-1061340624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-zeie3yjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1121a299350a43539a236db2eee5144f',uuid=ee99b427-804f-4de5-936c-1cd5cb6c5e82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:7d,bridge_name='br-int',has_traffic_filtering=True,id=3ca45e8e-3e6d-4e4f-8b69-05eece009d38,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca45e8e-3e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.objects.instance [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'pci_devices' on Instance uuid ee99b427-804f-4de5-936c-1cd5cb6c5e82 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:47:00 user nova-compute[73254]:   <uuid>ee99b427-804f-4de5-936c-1cd5cb6c5e82</uuid>
Aug 14 15:47:00 user nova-compute[73254]:   <name>instance-00000030</name>
Aug 14 15:47:00 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:47:00 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:47:00 user nova-compute[73254]:   <metadata>
Aug 14 15:47:00 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:47:00 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:47:00 user nova-compute[73254]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-575773132</nova:name>
Aug 14 15:47:00 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:46:58</nova:creationTime>
Aug 14 15:47:00 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:47:00 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:47:00 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:47:00 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:47:00 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:47:00 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:47:00 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:47:00 user nova-compute[73254]:       <nova:owner>
Aug 14 15:47:00 user nova-compute[73254]:         <nova:user uuid="1121a299350a43539a236db2eee5144f">tempest-TestVolumeBootPattern-428038303-project-member</nova:user>
Aug 14 15:47:00 user nova-compute[73254]:         <nova:project uuid="2f37aabc603240cfa2fe9c4ee4ec74e8">tempest-TestVolumeBootPattern-428038303</nova:project>
Aug 14 15:47:00 user nova-compute[73254]:       </nova:owner>
Aug 14 15:47:00 user nova-compute[73254]:       <nova:ports>
Aug 14 15:47:00 user nova-compute[73254]:         <nova:port uuid="3ca45e8e-3e6d-4e4f-8b69-05eece009d38">
Aug 14 15:47:00 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 14 15:47:00 user nova-compute[73254]:         </nova:port>
Aug 14 15:47:00 user nova-compute[73254]:       </nova:ports>
Aug 14 15:47:00 user nova-compute[73254]:     </nova:instance>
Aug 14 15:47:00 user nova-compute[73254]:   </metadata>
Aug 14 15:47:00 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:47:00 user nova-compute[73254]:     <system>
Aug 14 15:47:00 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:47:00 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:47:00 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:47:00 user nova-compute[73254]:       <entry name="serial">ee99b427-804f-4de5-936c-1cd5cb6c5e82</entry>
Aug 14 15:47:00 user nova-compute[73254]:       <entry name="uuid">ee99b427-804f-4de5-936c-1cd5cb6c5e82</entry>
Aug 14 15:47:00 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:47:00 user nova-compute[73254]:     </system>
Aug 14 15:47:00 user nova-compute[73254]:   </sysinfo>
Aug 14 15:47:00 user nova-compute[73254]:   <os>
Aug 14 15:47:00 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:47:00 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:47:00 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:47:00 user nova-compute[73254]:   </os>
Aug 14 15:47:00 user nova-compute[73254]:   <features>
Aug 14 15:47:00 user nova-compute[73254]:     <acpi/>
Aug 14 15:47:00 user nova-compute[73254]:     <apic/>
Aug 14 15:47:00 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:47:00 user nova-compute[73254]:   </features>
Aug 14 15:47:00 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:47:00 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:47:00 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:47:00 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:47:00 user nova-compute[73254]:   </clock>
Aug 14 15:47:00 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:47:00 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:47:00 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:47:00 user nova-compute[73254]:   </cpu>
Aug 14 15:47:00 user nova-compute[73254]:   <devices>
Aug 14 15:47:00 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:47:00 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:47:00 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 15:47:00 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:47:00 user nova-compute[73254]:       <serial>09c5214b-8d6e-4742-a63f-7f7c1d749c9f</serial>
Aug 14 15:47:00 user nova-compute[73254]:     </disk>
Aug 14 15:47:00 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:47:00 user nova-compute[73254]:       <mac address="fa:16:3e:36:3b:7d"/>
Aug 14 15:47:00 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:47:00 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:47:00 user nova-compute[73254]:       <target dev="tap3ca45e8e-3e"/>
Aug 14 15:47:00 user nova-compute[73254]:     </interface>
Aug 14 15:47:00 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:47:00 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/ee99b427-804f-4de5-936c-1cd5cb6c5e82/console.log" append="off"/>
Aug 14 15:47:00 user nova-compute[73254]:     </serial>
Aug 14 15:47:00 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:47:00 user nova-compute[73254]:     <video>
Aug 14 15:47:00 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:47:00 user nova-compute[73254]:     </video>
Aug 14 15:47:00 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:47:00 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:47:00 user nova-compute[73254]:     </rng>
Aug 14 15:47:00 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:47:00 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:47:00 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:47:00 user nova-compute[73254]:     </memballoon>
Aug 14 15:47:00 user nova-compute[73254]:   </devices>
Aug 14 15:47:00 user nova-compute[73254]: </domain>
Aug 14 15:47:00 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-575773132',display_name='tempest-TestVolumeBootPattern-volume-backed-server-575773132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-575773132',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGP9sOS2jJNwjsnWx6gXmLjxsw7S+O1pW1bziG7Lw1ClRcfVDp0QyQU5itmbc6+FxrrBbYY8VYJaIm67W7mIjne07jGnDNs3fU7B1E1dZEWfgLqOskH0OC4ZvvgmJjnW7w==',key_name='tempest-keypair-1061340624',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-zeie3yjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1121a299350a43539a236db2eee5144f',uuid=ee99b427-804f-4de5-936c-1cd5cb6c5e82,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:7d,bridge_name='br-int',has_traffic_filtering=True,id=3ca45e8e-3e6d-4e4f-8b69-05eece009d38,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca45e8e-3e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG os_vif [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:7d,bridge_name='br-int',has_traffic_filtering=True,id=3ca45e8e-3e6d-4e4f-8b69-05eece009d38,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca45e8e-3e') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ca45e8e-3e, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ca45e8e-3e, col_values=(('external_ids', {'iface-id': '3ca45e8e-3e6d-4e4f-8b69-05eece009d38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:3b:7d', 'vm-uuid': 'ee99b427-804f-4de5-936c-1cd5cb6c5e82'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:00 user nova-compute[73254]: INFO os_vif [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:3b:7d,bridge_name='br-int',has_traffic_filtering=True,id=3ca45e8e-3e6d-4e4f-8b69-05eece009d38,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca45e8e-3e')
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:47:00 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No VIF found with MAC fa:16:3e:36:3b:7d, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:47:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-740c53d7-f7c3-4acd-bc1b-7b0d842ec4cd req-26be4dd1-7e4d-4e3d-a088-e766ae64c800 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received event network-vif-plugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:47:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-740c53d7-f7c3-4acd-bc1b-7b0d842ec4cd req-26be4dd1-7e4d-4e3d-a088-e766ae64c800 service nova] Acquiring lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:47:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-740c53d7-f7c3-4acd-bc1b-7b0d842ec4cd req-26be4dd1-7e4d-4e3d-a088-e766ae64c800 service nova] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:47:01 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-740c53d7-f7c3-4acd-bc1b-7b0d842ec4cd req-26be4dd1-7e4d-4e3d-a088-e766ae64c800 service nova] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:47:01 user nova-compute[73254]: DEBUG nova.compute.manager [req-740c53d7-f7c3-4acd-bc1b-7b0d842ec4cd req-26be4dd1-7e4d-4e3d-a088-e766ae64c800 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] No waiting events found dispatching network-vif-plugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:47:01 user nova-compute[73254]: WARNING nova.compute.manager [req-740c53d7-f7c3-4acd-bc1b-7b0d842ec4cd req-26be4dd1-7e4d-4e3d-a088-e766ae64c800 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received unexpected event network-vif-plugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 for instance with vm_state building and task_state spawning.
Aug 14 15:47:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692028023.570387, ee99b427-804f-4de5-936c-1cd5cb6c5e82 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:47:03 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] VM Resumed (Lifecycle Event)
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:47:03 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Instance spawned successfully.
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:47:03 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692028023.572623, ee99b427-804f-4de5-936c-1cd5cb6c5e82 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:47:03 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] VM Started (Lifecycle Event)
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:47:03 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:47:03 user nova-compute[73254]: INFO nova.compute.manager [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Took 5.00 seconds to spawn the instance on the hypervisor.
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.compute.manager [req-d0365ff7-12b2-4df2-9441-bfd4186d2ad9 req-f38279b5-bac5-4a0c-8e67-1b26f5bb9022 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received event network-vif-plugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0365ff7-12b2-4df2-9441-bfd4186d2ad9 req-f38279b5-bac5-4a0c-8e67-1b26f5bb9022 service nova] Acquiring lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0365ff7-12b2-4df2-9441-bfd4186d2ad9 req-f38279b5-bac5-4a0c-8e67-1b26f5bb9022 service nova] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-d0365ff7-12b2-4df2-9441-bfd4186d2ad9 req-f38279b5-bac5-4a0c-8e67-1b26f5bb9022 service nova] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:47:03 user nova-compute[73254]: DEBUG nova.compute.manager [req-d0365ff7-12b2-4df2-9441-bfd4186d2ad9 req-f38279b5-bac5-4a0c-8e67-1b26f5bb9022 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] No waiting events found dispatching network-vif-plugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:47:03 user nova-compute[73254]: WARNING nova.compute.manager [req-d0365ff7-12b2-4df2-9441-bfd4186d2ad9 req-f38279b5-bac5-4a0c-8e67-1b26f5bb9022 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received unexpected event network-vif-plugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 for instance with vm_state building and task_state spawning.
Aug 14 15:47:03 user nova-compute[73254]: INFO nova.compute.manager [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Took 13.68 seconds to build instance.
Aug 14 15:47:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-25f1d5d7-adb5-4af9-ac65-1ecc17f591d9 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.777s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:47:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:47:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:47:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:47:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:47:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:47:37 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:47:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:47:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:47:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:47:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8773MB free_disk=25.160232543945312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:47:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:47:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:47:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ee99b427-804f-4de5-936c-1cd5cb6c5e82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:47:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:47:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:47:38 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:47:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:47:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:47:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:47:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:47:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:47:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:47:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:47:39 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:47:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:47:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:47:39 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:47:39 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid ee99b427-804f-4de5-936c-1cd5cb6c5e82 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:47:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:47:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:47:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:47:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:47:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:40 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updating instance_info_cache with network_info: [{"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:47:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:47:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:47:41 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:47:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:47:43 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:47:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:47:48 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:47:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:47:50 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:47:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:48:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:48:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:35 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:48:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:48:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:48:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:48:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:48:37 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:48:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:48:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:48:38 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:48:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.159690856933594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:48:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:48:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:48:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ee99b427-804f-4de5-936c-1cd5cb6c5e82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:48:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:48:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:48:38 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:48:38 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:48:38 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:48:38 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.178s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:48:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:48:40 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:48:40 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:48:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-aef0451d-880d-4d04-be2f-2b339dc0c062 req-df258075-3cf1-459e-ada5-854b1b22f58b service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received event network-changed-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:48:41 user nova-compute[73254]: DEBUG nova.compute.manager [req-aef0451d-880d-4d04-be2f-2b339dc0c062 req-df258075-3cf1-459e-ada5-854b1b22f58b service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Refreshing instance network info cache due to event network-changed-3ca45e8e-3e6d-4e4f-8b69-05eece009d38. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:48:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-aef0451d-880d-4d04-be2f-2b339dc0c062 req-df258075-3cf1-459e-ada5-854b1b22f58b service nova] Acquiring lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:48:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-aef0451d-880d-4d04-be2f-2b339dc0c062 req-df258075-3cf1-459e-ada5-854b1b22f58b service nova] Acquired lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:48:41 user nova-compute[73254]: DEBUG nova.network.neutron [req-aef0451d-880d-4d04-be2f-2b339dc0c062 req-df258075-3cf1-459e-ada5-854b1b22f58b service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Refreshing network info cache for port 3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:48:41 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:48:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:48:41 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:48:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG nova.network.neutron [req-aef0451d-880d-4d04-be2f-2b339dc0c062 req-df258075-3cf1-459e-ada5-854b1b22f58b service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updated VIF entry in instance network info cache for port 3ca45e8e-3e6d-4e4f-8b69-05eece009d38. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG nova.network.neutron [req-aef0451d-880d-4d04-be2f-2b339dc0c062 req-df258075-3cf1-459e-ada5-854b1b22f58b service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updating instance_info_cache with network_info: [{"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-aef0451d-880d-4d04-be2f-2b339dc0c062 req-df258075-3cf1-459e-ada5-854b1b22f58b service nova] Releasing lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid ee99b427-804f-4de5-936c-1cd5cb6c5e82 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updating instance_info_cache with network_info: [{"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:48:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:44 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:48:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:50 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:48:50 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:48:50 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:48:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "dc0c6c76-2176-4419-b25d-ee92a24abf93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:48:53 user nova-compute[73254]: INFO nova.compute.claims [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Claim successful on node user
Aug 14 15:48:53 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:48:53 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:48:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:48:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:48:53 user nova-compute[73254]: INFO nova.virt.block_device [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Booting with volume snapshot a29076fa-9689-490f-b5f2-9fa1d903d984 at /dev/vda
Aug 14 15:48:53 user nova-compute[73254]: DEBUG nova.policy [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1121a299350a43539a236db2eee5144f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f37aabc603240cfa2fe9c4ee4ec74e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:48:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:55 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Successfully created port: 73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Successfully updated port: 73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquired lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-29c31ba5-387f-46c0-8f2c-b243be334e70 req-27c0c1ba-9c9e-496f-80c4-4a589b4493ad service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received event network-changed-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG nova.compute.manager [req-29c31ba5-387f-46c0-8f2c-b243be334e70 req-27c0c1ba-9c9e-496f-80c4-4a589b4493ad service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Refreshing instance network info cache due to event network-changed-73f94853-db3b-434d-a41c-2c6257eb7ef1. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-29c31ba5-387f-46c0-8f2c-b243be334e70 req-27c0c1ba-9c9e-496f-80c4-4a589b4493ad service nova] Acquiring lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Updating instance_info_cache with network_info: [{"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Releasing lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Instance network_info: |[{"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-29c31ba5-387f-46c0-8f2c-b243be334e70 req-27c0c1ba-9c9e-496f-80c4-4a589b4493ad service nova] Acquired lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG nova.network.neutron [req-29c31ba5-387f-46c0-8f2c-b243be334e70 req-27c0c1ba-9c9e-496f-80c4-4a589b4493ad service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Refreshing network info cache for port 73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG nova.network.neutron [req-29c31ba5-387f-46c0-8f2c-b243be334e70 req-27c0c1ba-9c9e-496f-80c4-4a589b4493ad service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Updated VIF entry in instance network info cache for port 73f94853-db3b-434d-a41c-2c6257eb7ef1. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG nova.network.neutron [req-29c31ba5-387f-46c0-8f2c-b243be334e70 req-27c0c1ba-9c9e-496f-80c4-4a589b4493ad service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Updating instance_info_cache with network_info: [{"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:48:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-29c31ba5-387f-46c0-8f2c-b243be334e70 req-27c0c1ba-9c9e-496f-80c4-4a589b4493ad service nova] Releasing lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:48:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG os_brick.utils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ece9ff-3cbe-4cd1-92df-fdfbe379bf16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4925750-28bb-4463-beb7-3ca6dd919a07]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee349acb-4941-43e7-ab3a-c2f03ae7669b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b69646-4f40-4647-84ee-3ee786e8454f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:48:59 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:48:59 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab786cf-429f-4860-8adb-d171100e9c1f]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG os_brick.utils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:48:59 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Updating existing volume attachment record: c083a112-08c2-44fc-a5d1-876d9cbc7528 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:49:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:49:08 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Creating image(s)
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Ensure instance console log exists: /opt/stack/data/nova/instances/dc0c6c76-2176-4419-b25d-ee92a24abf93/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Start _get_guest_xml network_info=[{"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T15:48:44Z,direct_url=<?>,disk_format='qcow2',id=2334ed43-55ad-44ce-b1df-e2920c25ebc8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1661914759',owner='2f37aabc603240cfa2fe9c4ee4ec74e8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T15:48:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'c083a112-08c2-44fc-a5d1-876d9cbc7528', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': True, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxLVubOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc0c6c76-2176-4419-b25d-ee92a24abf93', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5649dc2-a1c7-4065-bb45-aea2d662873c', 'serial': 'f5649dc2-a1c7-4065-bb45-aea2d662873c'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:49:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:49:08 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-14T15:48:44Z,direct_url=<?>,disk_format='qcow2',id=2334ed43-55ad-44ce-b1df-e2920c25ebc8,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1661914759',owner='2f37aabc603240cfa2fe9c4ee4ec74e8',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-14T15:48:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxLVubOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:49:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:49:08 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:49:08 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c434825a-ea5a-4d69-b712-63c4618857a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:49:08 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01b1fb8-f06d-4a64-b5dd-193ae2bfcc48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c] added
Aug 14 15:49:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adee0c3-77ee-409b-a114-fa423abbaab5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[db77a593-9db6-4e6c-94ec-9d67a64554ca]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxLVubOQ {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TxLVubOQ" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b06287e-e140-430d-8544-c8aa1d4425ea]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TxLVubOQ'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5361a52-77cb-43eb-98e9-331ef7796647]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e15878-6871-4fc0-b501-73e833fc5162]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)
Aug 14 15:49:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)
Aug 14 15:49:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b8ca0a-9c70-4a43-9b22-e8472d9a6a4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c, portal: 172.16.0.220,3260]
Aug 14 15:49:08 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c, portal: 172.16.0.220,3260] successful.
Aug 14 15:49:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c966e588-6a63-43e5-874c-290d7bbad540]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[514145bb-f68e-4845-8218-a1b774eea6c0]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)
Aug 14 15:49:08 user nova-compute[73254]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c (non-flash)
Aug 14 15:49:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)
Aug 14 15:49:08 user nova-compute[73254]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c (non-flash)
Aug 14 15:49:08 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8415f13f-4e32-44d6-b177-c0e10f75bc85]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:49:08 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxLVubOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26335643832326132', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335643832326132', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1945586643',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1945586643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1945586643',id=49,image_ref='2334ed43-55ad-44ce-b1df-e2920c25ebc8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzOhZuFt/1t9SfbK3CBQgPnie5k0uiL7lz5rZi34ucxwXBwxFuNaIqLaOWyfezzl/cmBMWjav72KTiqEOQFdwIZ3sDfoDafJqpypG8cxOIRFWlcs/PhLNGoEBG0trDB+A==',key_name='tempest-keypair-623325420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-cs9k04a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-428038303',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1121a299350a43539a236db2eee5144f',uuid=dc0c6c76-2176-4419-b25d-ee92a24abf93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:29:3c,bridge_name='br-int',has_traffic_filtering=True,id=73f94853-db3b-434d-a41c-2c6257eb7ef1,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73f94853-db') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.objects.instance [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'pci_devices' on Instance uuid dc0c6c76-2176-4419-b25d-ee92a24abf93 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:49:09 user nova-compute[73254]:   <uuid>dc0c6c76-2176-4419-b25d-ee92a24abf93</uuid>
Aug 14 15:49:09 user nova-compute[73254]:   <name>instance-00000031</name>
Aug 14 15:49:09 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:49:09 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:49:09 user nova-compute[73254]:   <metadata>
Aug 14 15:49:09 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:49:09 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:49:09 user nova-compute[73254]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1945586643</nova:name>
Aug 14 15:49:09 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:49:08</nova:creationTime>
Aug 14 15:49:09 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:49:09 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:49:09 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:49:09 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:49:09 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:49:09 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:49:09 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:49:09 user nova-compute[73254]:       <nova:owner>
Aug 14 15:49:09 user nova-compute[73254]:         <nova:user uuid="1121a299350a43539a236db2eee5144f">tempest-TestVolumeBootPattern-428038303-project-member</nova:user>
Aug 14 15:49:09 user nova-compute[73254]:         <nova:project uuid="2f37aabc603240cfa2fe9c4ee4ec74e8">tempest-TestVolumeBootPattern-428038303</nova:project>
Aug 14 15:49:09 user nova-compute[73254]:       </nova:owner>
Aug 14 15:49:09 user nova-compute[73254]:       <nova:root type="image" uuid="2334ed43-55ad-44ce-b1df-e2920c25ebc8"/>
Aug 14 15:49:09 user nova-compute[73254]:       <nova:ports>
Aug 14 15:49:09 user nova-compute[73254]:         <nova:port uuid="73f94853-db3b-434d-a41c-2c6257eb7ef1">
Aug 14 15:49:09 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 14 15:49:09 user nova-compute[73254]:         </nova:port>
Aug 14 15:49:09 user nova-compute[73254]:       </nova:ports>
Aug 14 15:49:09 user nova-compute[73254]:     </nova:instance>
Aug 14 15:49:09 user nova-compute[73254]:   </metadata>
Aug 14 15:49:09 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:49:09 user nova-compute[73254]:     <system>
Aug 14 15:49:09 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:49:09 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:49:09 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:49:09 user nova-compute[73254]:       <entry name="serial">dc0c6c76-2176-4419-b25d-ee92a24abf93</entry>
Aug 14 15:49:09 user nova-compute[73254]:       <entry name="uuid">dc0c6c76-2176-4419-b25d-ee92a24abf93</entry>
Aug 14 15:49:09 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:49:09 user nova-compute[73254]:     </system>
Aug 14 15:49:09 user nova-compute[73254]:   </sysinfo>
Aug 14 15:49:09 user nova-compute[73254]:   <os>
Aug 14 15:49:09 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:49:09 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:49:09 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:49:09 user nova-compute[73254]:   </os>
Aug 14 15:49:09 user nova-compute[73254]:   <features>
Aug 14 15:49:09 user nova-compute[73254]:     <acpi/>
Aug 14 15:49:09 user nova-compute[73254]:     <apic/>
Aug 14 15:49:09 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:49:09 user nova-compute[73254]:   </features>
Aug 14 15:49:09 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:49:09 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:49:09 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:49:09 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:49:09 user nova-compute[73254]:   </clock>
Aug 14 15:49:09 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:49:09 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:49:09 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:49:09 user nova-compute[73254]:   </cpu>
Aug 14 15:49:09 user nova-compute[73254]:   <devices>
Aug 14 15:49:09 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:49:09 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:49:09 user nova-compute[73254]:       <source dev="/dev/sdc"/>
Aug 14 15:49:09 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:49:09 user nova-compute[73254]:       <serial>f5649dc2-a1c7-4065-bb45-aea2d662873c</serial>
Aug 14 15:49:09 user nova-compute[73254]:     </disk>
Aug 14 15:49:09 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:49:09 user nova-compute[73254]:       <mac address="fa:16:3e:19:29:3c"/>
Aug 14 15:49:09 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:49:09 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:49:09 user nova-compute[73254]:       <target dev="tap73f94853-db"/>
Aug 14 15:49:09 user nova-compute[73254]:     </interface>
Aug 14 15:49:09 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:49:09 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/dc0c6c76-2176-4419-b25d-ee92a24abf93/console.log" append="off"/>
Aug 14 15:49:09 user nova-compute[73254]:     </serial>
Aug 14 15:49:09 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:49:09 user nova-compute[73254]:     <video>
Aug 14 15:49:09 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:49:09 user nova-compute[73254]:     </video>
Aug 14 15:49:09 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:49:09 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:49:09 user nova-compute[73254]:     </rng>
Aug 14 15:49:09 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:49:09 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:49:09 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:49:09 user nova-compute[73254]:     </memballoon>
Aug 14 15:49:09 user nova-compute[73254]:   </devices>
Aug 14 15:49:09 user nova-compute[73254]: </domain>
Aug 14 15:49:09 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1945586643',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1945586643',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1945586643',id=49,image_ref='2334ed43-55ad-44ce-b1df-e2920c25ebc8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzOhZuFt/1t9SfbK3CBQgPnie5k0uiL7lz5rZi34ucxwXBwxFuNaIqLaOWyfezzl/cmBMWjav72KTiqEOQFdwIZ3sDfoDafJqpypG8cxOIRFWlcs/PhLNGoEBG0trDB+A==',key_name='tempest-keypair-623325420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-cs9k04a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-428038303',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:48:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1121a299350a43539a236db2eee5144f',uuid=dc0c6c76-2176-4419-b25d-ee92a24abf93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:29:3c,bridge_name='br-int',has_traffic_filtering=True,id=73f94853-db3b-434d-a41c-2c6257eb7ef1,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73f94853-db') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG os_vif [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:29:3c,bridge_name='br-int',has_traffic_filtering=True,id=73f94853-db3b-434d-a41c-2c6257eb7ef1,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73f94853-db') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73f94853-db, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73f94853-db, col_values=(('external_ids', {'iface-id': '73f94853-db3b-434d-a41c-2c6257eb7ef1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:29:3c', 'vm-uuid': 'dc0c6c76-2176-4419-b25d-ee92a24abf93'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:09 user nova-compute[73254]: INFO os_vif [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:29:3c,bridge_name='br-int',has_traffic_filtering=True,id=73f94853-db3b-434d-a41c-2c6257eb7ef1,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73f94853-db')
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:49:09 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No VIF found with MAC fa:16:3e:19:29:3c, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:49:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-9d0a5394-1937-45e3-89f7-9084b57f8258 req-01deab99-128e-4be7-a67c-a24633a543c9 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received event network-vif-plugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:49:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d0a5394-1937-45e3-89f7-9084b57f8258 req-01deab99-128e-4be7-a67c-a24633a543c9 service nova] Acquiring lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:49:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d0a5394-1937-45e3-89f7-9084b57f8258 req-01deab99-128e-4be7-a67c-a24633a543c9 service nova] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:49:10 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9d0a5394-1937-45e3-89f7-9084b57f8258 req-01deab99-128e-4be7-a67c-a24633a543c9 service nova] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:49:10 user nova-compute[73254]: DEBUG nova.compute.manager [req-9d0a5394-1937-45e3-89f7-9084b57f8258 req-01deab99-128e-4be7-a67c-a24633a543c9 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] No waiting events found dispatching network-vif-plugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:49:10 user nova-compute[73254]: WARNING nova.compute.manager [req-9d0a5394-1937-45e3-89f7-9084b57f8258 req-01deab99-128e-4be7-a67c-a24633a543c9 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received unexpected event network-vif-plugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 for instance with vm_state building and task_state spawning.
Aug 14 15:49:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692028152.7549632, dc0c6c76-2176-4419-b25d-ee92a24abf93 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:49:12 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] VM Resumed (Lifecycle Event)
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:49:12 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Instance spawned successfully.
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:49:12 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692028152.7562659, dc0c6c76-2176-4419-b25d-ee92a24abf93 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:49:12 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] VM Started (Lifecycle Event)
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:12 user nova-compute[73254]: INFO nova.compute.manager [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Took 4.79 seconds to spawn the instance on the hypervisor.
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:49:12 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:49:12 user nova-compute[73254]: INFO nova.compute.manager [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Took 19.49 seconds to build instance.
Aug 14 15:49:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-0c13f7b6-08a9-4570-8911-e1fe81ca1e13 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.588s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-0df65101-0763-4fec-9362-8e2111783ccb req-788d4487-f770-4b5f-8431-0eb6da302fe0 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received event network-vif-plugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0df65101-0763-4fec-9362-8e2111783ccb req-788d4487-f770-4b5f-8431-0eb6da302fe0 service nova] Acquiring lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0df65101-0763-4fec-9362-8e2111783ccb req-788d4487-f770-4b5f-8431-0eb6da302fe0 service nova] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0df65101-0763-4fec-9362-8e2111783ccb req-788d4487-f770-4b5f-8431-0eb6da302fe0 service nova] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:49:12 user nova-compute[73254]: DEBUG nova.compute.manager [req-0df65101-0763-4fec-9362-8e2111783ccb req-788d4487-f770-4b5f-8431-0eb6da302fe0 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] No waiting events found dispatching network-vif-plugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:49:12 user nova-compute[73254]: WARNING nova.compute.manager [req-0df65101-0763-4fec-9362-8e2111783ccb req-788d4487-f770-4b5f-8431-0eb6da302fe0 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received unexpected event network-vif-plugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 for instance with vm_state active and task_state None.
Aug 14 15:49:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:34 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:49:37 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:49:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:49:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:49:39 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:49:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:49:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:49:40 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:49:40 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:49:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8634MB free_disk=25.157649993896484GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:49:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:49:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:49:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ee99b427-804f-4de5-936c-1cd5cb6c5e82 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:49:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance dc0c6c76-2176-4419-b25d-ee92a24abf93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:49:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:49:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:49:40 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:49:40 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:49:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:49:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.304s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:49:42 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:42 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:49:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:49:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:49:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:49:42 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:49:42 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid ee99b427-804f-4de5-936c-1cd5cb6c5e82 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:49:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:43 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updating instance_info_cache with network_info: [{"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:49:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-ee99b427-804f-4de5-936c-1cd5cb6c5e82" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:49:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:49:43 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:44 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:49:46 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:49:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:49:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:49:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:49:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:49:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:50:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:50:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:50:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:50:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:50:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:50:39 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:50:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:50:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:50:40 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:50:40 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:50:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8720MB free_disk=25.157024383544922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:50:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:50:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:50:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ee99b427-804f-4de5-936c-1cd5cb6c5e82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:50:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance dc0c6c76-2176-4419-b25d-ee92a24abf93 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:50:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:50:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:50:40 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:50:40 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:50:40 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:50:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.186s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:50:43 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:50:43 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:50:43 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:50:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:50:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:50:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:50:43 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Updating instance_info_cache with network_info: [{"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-3c44bd47-a9fa-4852-a8b6-619ea77925ad req-e72ab230-d1fd-4d01-b579-cf558e2aa2d3 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received event network-changed-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG nova.compute.manager [req-3c44bd47-a9fa-4852-a8b6-619ea77925ad req-e72ab230-d1fd-4d01-b579-cf558e2aa2d3 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Refreshing instance network info cache due to event network-changed-73f94853-db3b-434d-a41c-2c6257eb7ef1. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3c44bd47-a9fa-4852-a8b6-619ea77925ad req-e72ab230-d1fd-4d01-b579-cf558e2aa2d3 service nova] Acquiring lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3c44bd47-a9fa-4852-a8b6-619ea77925ad req-e72ab230-d1fd-4d01-b579-cf558e2aa2d3 service nova] Acquired lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:50:44 user nova-compute[73254]: DEBUG nova.network.neutron [req-3c44bd47-a9fa-4852-a8b6-619ea77925ad req-e72ab230-d1fd-4d01-b579-cf558e2aa2d3 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Refreshing network info cache for port 73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "dc0c6c76-2176-4419-b25d-ee92a24abf93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:50:45 user nova-compute[73254]: INFO nova.compute.manager [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Terminating instance
Aug 14 15:50:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG nova.network.neutron [req-3c44bd47-a9fa-4852-a8b6-619ea77925ad req-e72ab230-d1fd-4d01-b579-cf558e2aa2d3 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Updated VIF entry in instance network info cache for port 73f94853-db3b-434d-a41c-2c6257eb7ef1. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG nova.network.neutron [req-3c44bd47-a9fa-4852-a8b6-619ea77925ad req-e72ab230-d1fd-4d01-b579-cf558e2aa2d3 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Updating instance_info_cache with network_info: [{"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3c44bd47-a9fa-4852-a8b6-619ea77925ad req-e72ab230-d1fd-4d01-b579-cf558e2aa2d3 service nova] Releasing lock "refresh_cache-dc0c6c76-2176-4419-b25d-ee92a24abf93" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-3167ee7c-46d3-4ed9-86c8-9b007425f30c req-527d2f5a-e330-442c-a25a-557010f16c45 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received event network-vif-unplugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3167ee7c-46d3-4ed9-86c8-9b007425f30c req-527d2f5a-e330-442c-a25a-557010f16c45 service nova] Acquiring lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3167ee7c-46d3-4ed9-86c8-9b007425f30c req-527d2f5a-e330-442c-a25a-557010f16c45 service nova] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-3167ee7c-46d3-4ed9-86c8-9b007425f30c req-527d2f5a-e330-442c-a25a-557010f16c45 service nova] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-3167ee7c-46d3-4ed9-86c8-9b007425f30c req-527d2f5a-e330-442c-a25a-557010f16c45 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] No waiting events found dispatching network-vif-unplugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-3167ee7c-46d3-4ed9-86c8-9b007425f30c req-527d2f5a-e330-442c-a25a-557010f16c45 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received event network-vif-unplugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:50:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:45 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Instance destroyed successfully.
Aug 14 15:50:45 user nova-compute[73254]: DEBUG nova.objects.instance [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'resources' on Instance uuid dc0c6c76-2176-4419-b25d-ee92a24abf93 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:48:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1945586643',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1945586643',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1945586643',id=49,image_ref='2334ed43-55ad-44ce-b1df-e2920c25ebc8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzOhZuFt/1t9SfbK3CBQgPnie5k0uiL7lz5rZi34ucxwXBwxFuNaIqLaOWyfezzl/cmBMWjav72KTiqEOQFdwIZ3sDfoDafJqpypG8cxOIRFWlcs/PhLNGoEBG0trDB+A==',key_name='tempest-keypair-623325420',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:49:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-cs9k04a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-428038303',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:49:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1121a299350a43539a236db2eee5144f',uuid=dc0c6c76-2176-4419-b25d-ee92a24abf93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "address": "fa:16:3e:19:29:3c", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73f94853-db", "ovs_interfaceid": "73f94853-db3b-434d-a41c-2c6257eb7ef1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:29:3c,bridge_name='br-int',has_traffic_filtering=True,id=73f94853-db3b-434d-a41c-2c6257eb7ef1,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73f94853-db') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_vif [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:29:3c,bridge_name='br-int',has_traffic_filtering=True,id=73f94853-db3b-434d-a41c-2c6257eb7ef1,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73f94853-db') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73f94853-db, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:50:46 user nova-compute[73254]: INFO os_vif [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:29:3c,bridge_name='br-int',has_traffic_filtering=True,id=73f94853-db3b-434d-a41c-2c6257eb7ef1,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73f94853-db')
Aug 14 15:50:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TxLVubOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:50:46 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85a5a76-cebd-43d5-87a4-9ee505676f1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1475918-a48b-4701-aadc-4c780ad1b960]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)
Aug 14 15:50:46 user nova-compute[73254]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c (non-flash)
Aug 14 15:50:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)
Aug 14 15:50:46 user nova-compute[73254]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c (non-flash)
Aug 14 15:50:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648377910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eabee5d-d402-4978-a118-b9bc58c93437]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf291af-1e22-4296-8fb2-041a42c5f97e]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[63153260-aa30-4c5c-977b-e169634408d1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d904d079-8c99-44cc-9fec-8505704e7c83]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6631b5a4', '/dev/disk/by-id/scsi-26335643832326132', '/dev/disk/by-id/scsi-1SCST_BIO6631b5a4-c5d822a24b81f86c') {{(pid=84090) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0719f1e7-fd4d-4667-96d6-31ad6171e0e5]: (4, None) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f39f655-7975-430e-a78d-0e7cc78a7558]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d6f26d-e97a-4fe2-aa98-899b75321b7f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c, portal: 172.16.0.220,3260]
Aug 14 15:50:46 user nova-compute[73254]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c, portal: 172.16.0.220,3260] successful.
Aug 14 15:50:46 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5649dc2-a1c7-4065-bb45-aea2d662873c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a760ac21-08ea-4b26-a7ff-b3e77cd5810c]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== disconnect_volume: return (268ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:50:46 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Deleting instance files /opt/stack/data/nova/instances/dc0c6c76-2176-4419-b25d-ee92a24abf93_del
Aug 14 15:50:46 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Deletion of /opt/stack/data/nova/instances/dc0c6c76-2176-4419-b25d-ee92a24abf93_del complete
Aug 14 15:50:46 user nova-compute[73254]: INFO nova.compute.manager [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 14 15:50:46 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:50:46 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:50:47 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:50:47 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Took 0.84 seconds to deallocate network for instance.
Aug 14 15:50:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-01d5a95b-861a-4e8e-819f-fa6580e7fe39 req-b114d4ec-595d-4326-ace8-6a9a8093e4dc service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received event network-vif-deleted-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:50:47 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:50:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-cccd45aa-e2f3-4b52-ac69-6d269cc0323f req-b5a95240-8a3f-4090-945d-e421c1ae06a6 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received event network-vif-plugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:50:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cccd45aa-e2f3-4b52-ac69-6d269cc0323f req-b5a95240-8a3f-4090-945d-e421c1ae06a6 service nova] Acquiring lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:50:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cccd45aa-e2f3-4b52-ac69-6d269cc0323f req-b5a95240-8a3f-4090-945d-e421c1ae06a6 service nova] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:50:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cccd45aa-e2f3-4b52-ac69-6d269cc0323f req-b5a95240-8a3f-4090-945d-e421c1ae06a6 service nova] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:50:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-cccd45aa-e2f3-4b52-ac69-6d269cc0323f req-b5a95240-8a3f-4090-945d-e421c1ae06a6 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] No waiting events found dispatching network-vif-plugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:50:47 user nova-compute[73254]: WARNING nova.compute.manager [req-cccd45aa-e2f3-4b52-ac69-6d269cc0323f req-b5a95240-8a3f-4090-945d-e421c1ae06a6 service nova] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Received unexpected event network-vif-plugged-73f94853-db3b-434d-a41c-2c6257eb7ef1 for instance with vm_state active and task_state deleting.
Aug 14 15:50:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:47 user nova-compute[73254]: INFO nova.compute.manager [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Took 0.73 seconds to detach 1 volumes for instance.
Aug 14 15:50:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Deleting volume: f5649dc2-a1c7-4065-bb45-aea2d662873c {{(pid=73254) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 15:50:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:50:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:50:48 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:50:48 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:50:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:50:48 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Deleted allocations for instance dc0c6c76-2176-4419-b25d-ee92a24abf93
Aug 14 15:50:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-22b2f3c8-860b-4cd9-8a53-2e4cc98a53ae tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "dc0c6c76-2176-4419-b25d-ee92a24abf93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.029s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:50:51 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:50:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:50:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:50:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:50:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:50:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:50:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:50:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:50:56 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:00 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692028245.987605, dc0c6c76-2176-4419-b25d-ee92a24abf93 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:51:00 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] VM Stopped (Lifecycle Event)
Aug 14 15:51:01 user nova-compute[73254]: DEBUG nova.compute.manager [None req-51b15e2d-5f89-4f4c-8a01-d4bb0b2527a0 None None] [instance: dc0c6c76-2176-4419-b25d-ee92a24abf93] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:51:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:51:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:51:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:51:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:51:01 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:06 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:11 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:51:16 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:51:21 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:51:26 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:51:31 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:51:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:39 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:51:40 user nova-compute[73254]: INFO nova.compute.manager [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Terminating instance
Aug 14 15:51:40 user nova-compute[73254]: DEBUG nova.compute.manager [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-881590d4-b6d9-4c9d-906c-5ebcb11aa065 req-fcfa2199-49de-408a-9dc1-20b5d97105c3 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received event network-vif-unplugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-881590d4-b6d9-4c9d-906c-5ebcb11aa065 req-fcfa2199-49de-408a-9dc1-20b5d97105c3 service nova] Acquiring lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-881590d4-b6d9-4c9d-906c-5ebcb11aa065 req-fcfa2199-49de-408a-9dc1-20b5d97105c3 service nova] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-881590d4-b6d9-4c9d-906c-5ebcb11aa065 req-fcfa2199-49de-408a-9dc1-20b5d97105c3 service nova] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-881590d4-b6d9-4c9d-906c-5ebcb11aa065 req-fcfa2199-49de-408a-9dc1-20b5d97105c3 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] No waiting events found dispatching network-vif-unplugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-881590d4-b6d9-4c9d-906c-5ebcb11aa065 req-fcfa2199-49de-408a-9dc1-20b5d97105c3 service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received event network-vif-unplugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:51:40 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Instance destroyed successfully.
Aug 14 15:51:40 user nova-compute[73254]: DEBUG nova.objects.instance [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'resources' on Instance uuid ee99b427-804f-4de5-936c-1cd5cb6c5e82 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-575773132',display_name='tempest-TestVolumeBootPattern-volume-backed-server-575773132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-575773132',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGP9sOS2jJNwjsnWx6gXmLjxsw7S+O1pW1bziG7Lw1ClRcfVDp0QyQU5itmbc6+FxrrBbYY8VYJaIm67W7mIjne07jGnDNs3fU7B1E1dZEWfgLqOskH0OC4ZvvgmJjnW7w==',key_name='tempest-keypair-1061340624',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:47:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-zeie3yjr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:47:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1121a299350a43539a236db2eee5144f',uuid=ee99b427-804f-4de5-936c-1cd5cb6c5e82,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "address": "fa:16:3e:36:3b:7d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca45e8e-3e", "ovs_interfaceid": "3ca45e8e-3e6d-4e4f-8b69-05eece009d38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:3b:7d,bridge_name='br-int',has_traffic_filtering=True,id=3ca45e8e-3e6d-4e4f-8b69-05eece009d38,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca45e8e-3e') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG os_vif [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:3b:7d,bridge_name='br-int',has_traffic_filtering=True,id=3ca45e8e-3e6d-4e4f-8b69-05eece009d38,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca45e8e-3e') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ca45e8e-3e, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:40 user nova-compute[73254]: INFO os_vif [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:3b:7d,bridge_name='br-int',has_traffic_filtering=True,id=3ca45e8e-3e6d-4e4f-8b69-05eece009d38,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca45e8e-3e')
Aug 14 15:51:40 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJpLuWit', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:51:40 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:51:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc8b4fd-e89b-40d0-bff3-73aaa135f8b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c1b8c-a13d-491b-8c20-e30512674e68]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)
Aug 14 15:51:40 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f (non-flash)
Aug 14 15:51:40 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd6483a24d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbb39f7-8b30-4483-bd98-0586909695b9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:51:40 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d46e3cd-7074-4f45-b467-1c8fa2e09329]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[090a0adc-6495-42aa-9d49-9ed465b9e327]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[517ab4b8-ff69-4719-bc8a-7c475fed5d14]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d96216-e14f-4bb2-957a-84240cb42ea6]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8794839a-9dd1-4e8c-a930-6d4ae6bdd743]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f, portal: 172.16.0.220,3260]
Aug 14 15:51:41 user nova-compute[73254]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f, portal: 172.16.0.220,3260] successful.
Aug 14 15:51:41 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:09c5214b-8d6e-4742-a63f-7f7c1d749c9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7007597-5c08-4ceb-b9b2-7528598c1f81]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== disconnect_volume: return (248ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:51:41 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Deleting instance files /opt/stack/data/nova/instances/ee99b427-804f-4de5-936c-1cd5cb6c5e82_del
Aug 14 15:51:41 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Deletion of /opt/stack/data/nova/instances/ee99b427-804f-4de5-936c-1cd5cb6c5e82_del complete
Aug 14 15:51:41 user nova-compute[73254]: INFO nova.compute.manager [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:51:41 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:51:42 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:51:42 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8919MB free_disk=25.156021118164062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance ee99b427-804f-4de5-936c-1cd5cb6c5e82 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:51:42 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Took 0.92 seconds to deallocate network for instance.
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-7cd72bae-0ba9-4b13-ac5b-82bda2457f7e req-d6c6d69a-cc62-4132-ba3d-e3eaaf77193f service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received event network-vif-deleted-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.351s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-6f64bdaa-b564-4efd-90f5-74462a65d2be req-3e6d8085-3707-4138-b797-17d288e2308f service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received event network-vif-plugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6f64bdaa-b564-4efd-90f5-74462a65d2be req-3e6d8085-3707-4138-b797-17d288e2308f service nova] Acquiring lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6f64bdaa-b564-4efd-90f5-74462a65d2be req-3e6d8085-3707-4138-b797-17d288e2308f service nova] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6f64bdaa-b564-4efd-90f5-74462a65d2be req-3e6d8085-3707-4138-b797-17d288e2308f service nova] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-6f64bdaa-b564-4efd-90f5-74462a65d2be req-3e6d8085-3707-4138-b797-17d288e2308f service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] No waiting events found dispatching network-vif-plugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:51:42 user nova-compute[73254]: WARNING nova.compute.manager [req-6f64bdaa-b564-4efd-90f5-74462a65d2be req-3e6d8085-3707-4138-b797-17d288e2308f service nova] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Received unexpected event network-vif-plugged-3ca45e8e-3e6d-4e4f-8b69-05eece009d38 for instance with vm_state active and task_state deleting.
Aug 14 15:51:42 user nova-compute[73254]: INFO nova.compute.manager [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Took 0.70 seconds to detach 1 volumes for instance.
Aug 14 15:51:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Deleting volume: 09c5214b-8d6e-4742-a63f-7f7c1d749c9f {{(pid=73254) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 14 15:51:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:51:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:51:43 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:51:43 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:51:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:51:43 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Deleted allocations for instance ee99b427-804f-4de5-936c-1cd5cb6c5e82
Aug 14 15:51:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-db639e6e-758b-43f1-946f-1c6d39ef4ee5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "ee99b427-804f-4de5-936c-1cd5cb6c5e82" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.133s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:51:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:51:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:51:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:51:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:51:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:51:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:51:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:51:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:51:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:48 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:51:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:51:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:51:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:51:55 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692028300.8746026, ee99b427-804f-4de5-936c-1cd5cb6c5e82 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:51:55 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] VM Stopped (Lifecycle Event)
Aug 14 15:51:55 user nova-compute[73254]: DEBUG nova.compute.manager [None req-a74b9742-9e97-42a3-87c0-dcaaee0904c9 None None] [instance: ee99b427-804f-4de5-936c-1cd5cb6c5e82] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:51:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:52:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:52:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:52:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:52:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:52:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:52:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:52:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:52:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:52:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:52:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:52:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:52:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:52:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:52:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:52:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:41 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:52:43 user nova-compute[73254]: INFO nova.compute.claims [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Claim successful on node user
Aug 14 15:52:43 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:52:43 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:52:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:52:43 user nova-compute[73254]: INFO nova.virt.block_device [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Booting with volume b15e5846-3a1b-4339-9fa1-821c415382f1 at /dev/vda
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG os_brick.utils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8ee507-79a8-478b-b09a-7b5b03d134e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:43 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:52:43 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:52:43 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8929MB free_disk=25.154605865478516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:52:43 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f629953-d42b-4388-8eb8-04db7f2d86a5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eb59af-992d-4987-9a15-52f0c5414379]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[558c8a7f-1c41-450e-ba03-340869c89972]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG nova.policy [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1121a299350a43539a236db2eee5144f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f37aabc603240cfa2fe9c4ee4ec74e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:52:44 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3232b9ca-1d9d-47fc-93ee-1944b2b770b4]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG os_brick.utils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== get_connector_properties: return (431ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Updating existing volume attachment record: 95795fc3-9906-4cdb-b40d-3bf6b99335fc {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 57632517-0101-4e5d-ad81-4a0dfdebe374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:52:44 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Successfully created port: 2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Successfully updated port: 2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquired lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-9fc46292-f340-45ea-bbc0-24a36b4b97f8 req-0c96705f-de9c-4350-818f-72d782c5686b service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-changed-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-9fc46292-f340-45ea-bbc0-24a36b4b97f8 req-0c96705f-de9c-4350-818f-72d782c5686b service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Refreshing instance network info cache due to event network-changed-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9fc46292-f340-45ea-bbc0-24a36b4b97f8 req-0c96705f-de9c-4350-818f-72d782c5686b service nova] Acquiring lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG nova.network.neutron [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Updating instance_info_cache with network_info: [{"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Releasing lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Instance network_info: |[{"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9fc46292-f340-45ea-bbc0-24a36b4b97f8 req-0c96705f-de9c-4350-818f-72d782c5686b service nova] Acquired lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG nova.network.neutron [req-9fc46292-f340-45ea-bbc0-24a36b4b97f8 req-0c96705f-de9c-4350-818f-72d782c5686b service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Refreshing network info cache for port 2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:52:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:46 user nova-compute[73254]: DEBUG nova.network.neutron [req-9fc46292-f340-45ea-bbc0-24a36b4b97f8 req-0c96705f-de9c-4350-818f-72d782c5686b service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Updated VIF entry in instance network info cache for port 2bec3fa3-07fc-48b4-96ab-717e1f9f8d54. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:52:46 user nova-compute[73254]: DEBUG nova.network.neutron [req-9fc46292-f340-45ea-bbc0-24a36b4b97f8 req-0c96705f-de9c-4350-818f-72d782c5686b service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Updating instance_info_cache with network_info: [{"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:52:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-9fc46292-f340-45ea-bbc0-24a36b4b97f8 req-0c96705f-de9c-4350-818f-72d782c5686b service nova] Releasing lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:52:46 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:52:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:52:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:52:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Skipping network cache update for instance because it is Building. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 14 15:52:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:52:47 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:52:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:52:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:52:52 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Creating image(s)
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Ensure instance console log exists: /opt/stack/data/nova/instances/57632517-0101-4e5d-ad81-4a0dfdebe374/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Start _get_guest_xml network_info=[{"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '95795fc3-9906-4cdb-b40d-3bf6b99335fc', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iImJFfPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '57632517-0101-4e5d-ad81-4a0dfdebe374', 'attached_at': '', 'detached_at': '', 'volume_id': 'b15e5846-3a1b-4339-9fa1-821c415382f1', 'serial': 'b15e5846-3a1b-4339-9fa1-821c415382f1'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:52:52 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:52:52 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iImJFfPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:52:52 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:52:52 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:52:52 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[805bfe9a-5964-4dec-b0a5-6421e357d663]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:52:52 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ecd5c7-0b90-4960-86c8-99dd293c7a80]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1] added
Aug 14 15:52:52 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b9e2a2-ce8c-4ed6-a19d-2abcfff372a1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d83643-ec54-4fa2-9b06-b1645e8fb1dd]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iImJFfPn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iImJFfPn" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b78ae56-eac6-44f8-8b95-5fd5975d1b3d]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iImJFfPn'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c1bfa7-5774-4ea3-9235-0d07623336b7]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[518af540-9220-4916-a05c-969cee3b87a2]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:52:52 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:52:52 user nova-compute[73254]:  {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:52:52 user nova-compute[73254]: WARNING os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 15:52:52 user nova-compute[73254]: 
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c320627f-a539-48c3-be16-000f025d14a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260]
Aug 14 15:52:52 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260] successful.
Aug 14 15:52:52 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.129s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39de209-981e-4a9f-9e70-a41fb23213c1]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[513129ad-07b1-4d84-b921-79c6aa871aec]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:52:52 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:52:52 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.370s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed12379-e96d-4e11-b995-d3b44ce491c8]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:52:52 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iImJFfPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26437366662356434', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437366662356434', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-656627245',display_name='tempest-TestVolumeBootPattern-server-656627245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-656627245',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJATuecSP8lZKZp1VGqwYzKyvpPEZ2TZhPL5o3D7c8SHr7s5NdPAi2VNOeMaM+wdM/dpFTOV4Z9S160u6kOMs4E8aXtwRQyV6Et31CEAxTOVWOeIQltG+hnu1knyenbapA==',key_name='tempest-TestVolumeBootPattern-388200609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-z9h7lk0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:52:44Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=57632517-0101-4e5d-ad81-4a0dfdebe374,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=2bec3fa3-07fc-48b4-96ab-717e1f9f8d54,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec3fa3-07') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.objects.instance [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'pci_devices' on Instance uuid 57632517-0101-4e5d-ad81-4a0dfdebe374 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:52:53 user nova-compute[73254]:   <uuid>57632517-0101-4e5d-ad81-4a0dfdebe374</uuid>
Aug 14 15:52:53 user nova-compute[73254]:   <name>instance-00000032</name>
Aug 14 15:52:53 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:52:53 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:52:53 user nova-compute[73254]:   <metadata>
Aug 14 15:52:53 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:52:53 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:52:53 user nova-compute[73254]:       <nova:name>tempest-TestVolumeBootPattern-server-656627245</nova:name>
Aug 14 15:52:53 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:52:52</nova:creationTime>
Aug 14 15:52:53 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:52:53 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:52:53 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:52:53 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:52:53 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:52:53 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:52:53 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:52:53 user nova-compute[73254]:       <nova:owner>
Aug 14 15:52:53 user nova-compute[73254]:         <nova:user uuid="1121a299350a43539a236db2eee5144f">tempest-TestVolumeBootPattern-428038303-project-member</nova:user>
Aug 14 15:52:53 user nova-compute[73254]:         <nova:project uuid="2f37aabc603240cfa2fe9c4ee4ec74e8">tempest-TestVolumeBootPattern-428038303</nova:project>
Aug 14 15:52:53 user nova-compute[73254]:       </nova:owner>
Aug 14 15:52:53 user nova-compute[73254]:       <nova:ports>
Aug 14 15:52:53 user nova-compute[73254]:         <nova:port uuid="2bec3fa3-07fc-48b4-96ab-717e1f9f8d54">
Aug 14 15:52:53 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 14 15:52:53 user nova-compute[73254]:         </nova:port>
Aug 14 15:52:53 user nova-compute[73254]:       </nova:ports>
Aug 14 15:52:53 user nova-compute[73254]:     </nova:instance>
Aug 14 15:52:53 user nova-compute[73254]:   </metadata>
Aug 14 15:52:53 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:52:53 user nova-compute[73254]:     <system>
Aug 14 15:52:53 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:52:53 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:52:53 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:52:53 user nova-compute[73254]:       <entry name="serial">57632517-0101-4e5d-ad81-4a0dfdebe374</entry>
Aug 14 15:52:53 user nova-compute[73254]:       <entry name="uuid">57632517-0101-4e5d-ad81-4a0dfdebe374</entry>
Aug 14 15:52:53 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:52:53 user nova-compute[73254]:     </system>
Aug 14 15:52:53 user nova-compute[73254]:   </sysinfo>
Aug 14 15:52:53 user nova-compute[73254]:   <os>
Aug 14 15:52:53 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:52:53 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:52:53 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:52:53 user nova-compute[73254]:   </os>
Aug 14 15:52:53 user nova-compute[73254]:   <features>
Aug 14 15:52:53 user nova-compute[73254]:     <acpi/>
Aug 14 15:52:53 user nova-compute[73254]:     <apic/>
Aug 14 15:52:53 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:52:53 user nova-compute[73254]:   </features>
Aug 14 15:52:53 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:52:53 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:52:53 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:52:53 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:52:53 user nova-compute[73254]:   </clock>
Aug 14 15:52:53 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:52:53 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:52:53 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:52:53 user nova-compute[73254]:   </cpu>
Aug 14 15:52:53 user nova-compute[73254]:   <devices>
Aug 14 15:52:53 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:52:53 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:52:53 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 15:52:53 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:52:53 user nova-compute[73254]:       <serial>b15e5846-3a1b-4339-9fa1-821c415382f1</serial>
Aug 14 15:52:53 user nova-compute[73254]:     </disk>
Aug 14 15:52:53 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:52:53 user nova-compute[73254]:       <mac address="fa:16:3e:02:4c:7e"/>
Aug 14 15:52:53 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:52:53 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:52:53 user nova-compute[73254]:       <target dev="tap2bec3fa3-07"/>
Aug 14 15:52:53 user nova-compute[73254]:     </interface>
Aug 14 15:52:53 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:52:53 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/57632517-0101-4e5d-ad81-4a0dfdebe374/console.log" append="off"/>
Aug 14 15:52:53 user nova-compute[73254]:     </serial>
Aug 14 15:52:53 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:52:53 user nova-compute[73254]:     <video>
Aug 14 15:52:53 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:52:53 user nova-compute[73254]:     </video>
Aug 14 15:52:53 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:52:53 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:52:53 user nova-compute[73254]:     </rng>
Aug 14 15:52:53 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:52:53 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:52:53 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:52:53 user nova-compute[73254]:     </memballoon>
Aug 14 15:52:53 user nova-compute[73254]:   </devices>
Aug 14 15:52:53 user nova-compute[73254]: </domain>
Aug 14 15:52:53 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-656627245',display_name='tempest-TestVolumeBootPattern-server-656627245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-656627245',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJATuecSP8lZKZp1VGqwYzKyvpPEZ2TZhPL5o3D7c8SHr7s5NdPAi2VNOeMaM+wdM/dpFTOV4Z9S160u6kOMs4E8aXtwRQyV6Et31CEAxTOVWOeIQltG+hnu1knyenbapA==',key_name='tempest-TestVolumeBootPattern-388200609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-z9h7lk0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:52:44Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=57632517-0101-4e5d-ad81-4a0dfdebe374,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=2bec3fa3-07fc-48b4-96ab-717e1f9f8d54,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec3fa3-07') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG os_vif [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=2bec3fa3-07fc-48b4-96ab-717e1f9f8d54,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec3fa3-07') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2bec3fa3-07, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2bec3fa3-07, col_values=(('external_ids', {'iface-id': '2bec3fa3-07fc-48b4-96ab-717e1f9f8d54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:4c:7e', 'vm-uuid': '57632517-0101-4e5d-ad81-4a0dfdebe374'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:53 user nova-compute[73254]: INFO os_vif [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=2bec3fa3-07fc-48b4-96ab-717e1f9f8d54,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec3fa3-07')
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:52:53 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No VIF found with MAC fa:16:3e:02:4c:7e, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-0ba0491d-2e7d-42ed-ba44-1bfee5ec8e95 req-0858e71c-8d9c-46a0-bb19-7519dcbce7e4 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0ba0491d-2e7d-42ed-ba44-1bfee5ec8e95 req-0858e71c-8d9c-46a0-bb19-7519dcbce7e4 service nova] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0ba0491d-2e7d-42ed-ba44-1bfee5ec8e95 req-0858e71c-8d9c-46a0-bb19-7519dcbce7e4 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-0ba0491d-2e7d-42ed-ba44-1bfee5ec8e95 req-0858e71c-8d9c-46a0-bb19-7519dcbce7e4 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG nova.compute.manager [req-0ba0491d-2e7d-42ed-ba44-1bfee5ec8e95 req-0858e71c-8d9c-46a0-bb19-7519dcbce7e4 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] No waiting events found dispatching network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:52:55 user nova-compute[73254]: WARNING nova.compute.manager [req-0ba0491d-2e7d-42ed-ba44-1bfee5ec8e95 req-0858e71c-8d9c-46a0-bb19-7519dcbce7e4 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received unexpected event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 for instance with vm_state building and task_state spawning.
Aug 14 15:52:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692028377.2386184, 57632517-0101-4e5d-ad81-4a0dfdebe374 => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:52:57 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] VM Resumed (Lifecycle Event)
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:52:57 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Instance spawned successfully.
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:52:57 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692028377.2409258, 57632517-0101-4e5d-ad81-4a0dfdebe374 => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:52:57 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] VM Started (Lifecycle Event)
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-5810c06f-cc4f-4927-a3ff-7f991ff23f95 req-6e840e00-ab89-415f-880f-c312f0863e4e service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5810c06f-cc4f-4927-a3ff-7f991ff23f95 req-6e840e00-ab89-415f-880f-c312f0863e4e service nova] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5810c06f-cc4f-4927-a3ff-7f991ff23f95 req-6e840e00-ab89-415f-880f-c312f0863e4e service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-5810c06f-cc4f-4927-a3ff-7f991ff23f95 req-6e840e00-ab89-415f-880f-c312f0863e4e service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.compute.manager [req-5810c06f-cc4f-4927-a3ff-7f991ff23f95 req-6e840e00-ab89-415f-880f-c312f0863e4e service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] No waiting events found dispatching network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:52:57 user nova-compute[73254]: WARNING nova.compute.manager [req-5810c06f-cc4f-4927-a3ff-7f991ff23f95 req-6e840e00-ab89-415f-880f-c312f0863e4e service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received unexpected event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 for instance with vm_state building and task_state spawning.
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:52:57 user nova-compute[73254]: INFO nova.compute.manager [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Took 5.09 seconds to spawn the instance on the hypervisor.
Aug 14 15:52:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:52:57 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:52:57 user nova-compute[73254]: INFO nova.compute.manager [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Took 14.36 seconds to build instance.
Aug 14 15:52:57 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-fa3775a9-acc8-4dad-9531-3235a999589f tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.459s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:52:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:52:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:53:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:53:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:53:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:53:42 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:53:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:44 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:53:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:53:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:53:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:53:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:53:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:53:45 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:53:45 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:53:46 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:53:46 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:53:46 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8777MB free_disk=25.153064727783203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:53:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:53:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:53:46 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 57632517-0101-4e5d-ad81-4a0dfdebe374 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:53:46 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:53:46 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:53:46 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:53:46 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:53:46 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:53:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 57632517-0101-4e5d-ad81-4a0dfdebe374 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Updating instance_info_cache with network_info: [{"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:53:48 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:53:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:53:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:53:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:53:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:53:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:53:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:53:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:53:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:53:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:53:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:54:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:54:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:54:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:54:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:54:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:54:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:54:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:54:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:54:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:54:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:54:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:54:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-398b892b-15df-4f62-8baf-c82c116f1432 req-83de9917-6b11-4783-84bf-679812b337ba service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-changed-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:54:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-398b892b-15df-4f62-8baf-c82c116f1432 req-83de9917-6b11-4783-84bf-679812b337ba service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Refreshing instance network info cache due to event network-changed-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:54:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-398b892b-15df-4f62-8baf-c82c116f1432 req-83de9917-6b11-4783-84bf-679812b337ba service nova] Acquiring lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:54:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-398b892b-15df-4f62-8baf-c82c116f1432 req-83de9917-6b11-4783-84bf-679812b337ba service nova] Acquired lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:54:35 user nova-compute[73254]: DEBUG nova.network.neutron [req-398b892b-15df-4f62-8baf-c82c116f1432 req-83de9917-6b11-4783-84bf-679812b337ba service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Refreshing network info cache for port 2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG nova.network.neutron [req-398b892b-15df-4f62-8baf-c82c116f1432 req-83de9917-6b11-4783-84bf-679812b337ba service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Updated VIF entry in instance network info cache for port 2bec3fa3-07fc-48b4-96ab-717e1f9f8d54. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG nova.network.neutron [req-398b892b-15df-4f62-8baf-c82c116f1432 req-83de9917-6b11-4783-84bf-679812b337ba service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Updating instance_info_cache with network_info: [{"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-398b892b-15df-4f62-8baf-c82c116f1432 req-83de9917-6b11-4783-84bf-679812b337ba service nova] Releasing lock "refresh_cache-57632517-0101-4e5d-ad81-4a0dfdebe374" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:36 user nova-compute[73254]: INFO nova.compute.manager [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Terminating instance
Aug 14 15:54:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:36 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-c62f441b-c236-4e64-900a-2c45ad66a1ea req-dd05f6fb-d52c-42ff-9a85-5aecf171990e service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-unplugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c62f441b-c236-4e64-900a-2c45ad66a1ea req-dd05f6fb-d52c-42ff-9a85-5aecf171990e service nova] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c62f441b-c236-4e64-900a-2c45ad66a1ea req-dd05f6fb-d52c-42ff-9a85-5aecf171990e service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-c62f441b-c236-4e64-900a-2c45ad66a1ea req-dd05f6fb-d52c-42ff-9a85-5aecf171990e service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-c62f441b-c236-4e64-900a-2c45ad66a1ea req-dd05f6fb-d52c-42ff-9a85-5aecf171990e service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] No waiting events found dispatching network-vif-unplugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-c62f441b-c236-4e64-900a-2c45ad66a1ea req-dd05f6fb-d52c-42ff-9a85-5aecf171990e service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-unplugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Instance destroyed successfully.
Aug 14 15:54:37 user nova-compute[73254]: DEBUG nova.objects.instance [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'resources' on Instance uuid 57632517-0101-4e5d-ad81-4a0dfdebe374 {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-656627245',display_name='tempest-TestVolumeBootPattern-server-656627245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-656627245',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJATuecSP8lZKZp1VGqwYzKyvpPEZ2TZhPL5o3D7c8SHr7s5NdPAi2VNOeMaM+wdM/dpFTOV4Z9S160u6kOMs4E8aXtwRQyV6Et31CEAxTOVWOeIQltG+hnu1knyenbapA==',key_name='tempest-TestVolumeBootPattern-388200609',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:52:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-z9h7lk0n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:52:57Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=57632517-0101-4e5d-ad81-4a0dfdebe374,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "address": "fa:16:3e:02:4c:7e", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2bec3fa3-07", "ovs_interfaceid": "2bec3fa3-07fc-48b4-96ab-717e1f9f8d54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=2bec3fa3-07fc-48b4-96ab-717e1f9f8d54,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec3fa3-07') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_vif [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=2bec3fa3-07fc-48b4-96ab-717e1f9f8d54,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec3fa3-07') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2bec3fa3-07, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:37 user nova-compute[73254]: INFO os_vif [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:4c:7e,bridge_name='br-int',has_traffic_filtering=True,id=2bec3fa3-07fc-48b4-96ab-717e1f9f8d54,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2bec3fa3-07')
Aug 14 15:54:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iImJFfPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:54:37 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[48894740-4f2b-4445-aafb-66f5969c3afb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef9b540-781b-4fb9-b7ee-cf4b76b64d63]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:54:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:54:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648370af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d27f6ff-a786-404b-af3c-2f262846202b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82c267c-5461-4e6e-b860-88acc4e49dd3]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fae721d-12eb-4df7-963e-3092ddcf2b0f]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83f674b-d308-4940-a8a6-83ff4dd9bdce]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26437366662356434', '/dev/disk/by-id/scsi-1SCST_BIO4d2f057e-d76fb5d499314599', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4d2f057e') {{(pid=84090) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e32971d-096b-4069-8c24-036b87dda065]: (4, None) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fde812-3fce-4615-aa04-d773216e94b5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[285eba91-ff87-4248-b5bd-1bb437516666]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260]
Aug 14 15:54:37 user nova-compute[73254]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260] successful.
Aug 14 15:54:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f417524-6928-485f-af2f-889110d144aa]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== disconnect_volume: return (316ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:54:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:54:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Deleting instance files /opt/stack/data/nova/instances/57632517-0101-4e5d-ad81-4a0dfdebe374_del
Aug 14 15:54:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Deletion of /opt/stack/data/nova/instances/57632517-0101-4e5d-ad81-4a0dfdebe374_del complete
Aug 14 15:54:38 user nova-compute[73254]: INFO nova.compute.manager [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Took 1.17 seconds to destroy the instance on the hypervisor.
Aug 14 15:54:38 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:54:38 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:54:38 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:54:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:54:39 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Took 1.20 seconds to deallocate network for instance.
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] No waiting events found dispatching network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:54:39 user nova-compute[73254]: WARNING nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received unexpected event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 for instance with vm_state active and task_state deleting.
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] No waiting events found dispatching network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:54:39 user nova-compute[73254]: WARNING nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received unexpected event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 for instance with vm_state active and task_state deleting.
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] No waiting events found dispatching network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:54:39 user nova-compute[73254]: WARNING nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received unexpected event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 for instance with vm_state active and task_state deleting.
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-unplugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] No waiting events found dispatching network-vif-unplugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-unplugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Acquiring lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] No waiting events found dispatching network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:54:39 user nova-compute[73254]: WARNING nova.compute.manager [req-11056a9e-1fb8-4be4-9c47-48593e991b55 req-abe89cce-f15d-4925-b9ca-5a7e93b84636 service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received unexpected event network-vif-plugged-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 for instance with vm_state active and task_state deleting.
Aug 14 15:54:39 user nova-compute[73254]: DEBUG nova.compute.manager [req-fbc56630-7cdd-48a7-a81a-8850a6020909 req-e3d6ec0c-7bd1-4dac-b153-83f1702a80cf service nova] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Received event network-vif-deleted-2bec3fa3-07fc-48b4-96ab-717e1f9f8d54 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:54:39 user nova-compute[73254]: INFO nova.compute.manager [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Took 0.73 seconds to detach 1 volumes for instance.
Aug 14 15:54:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:40 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:54:40 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:54:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:40 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Deleted allocations for instance 57632517-0101-4e5d-ad81-4a0dfdebe374
Aug 14 15:54:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-d5b3a489-d54c-475b-ab4d-8a6826313d41 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "57632517-0101-4e5d-ad81-4a0dfdebe374" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.389s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:44 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:44 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:44 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:54:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:45 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:54:45 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:54:45 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:54:45 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=25.152084350585938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:54:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:54:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:54:46 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:54:46 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:54:46 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:54:46 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:54:46 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:54:46 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:54:46 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:54:47 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:54:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:54:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 15:54:47 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:52 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692028477.616578, 57632517-0101-4e5d-ad81-4a0dfdebe374 => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:54:52 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] VM Stopped (Lifecycle Event)
Aug 14 15:54:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-3e7b47f0-f1de-4b6e-9ce2-d50c0e920510 None None] [instance: 57632517-0101-4e5d-ad81-4a0dfdebe374] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:54:52 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:53 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:55 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:54:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:54:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:54:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:54:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:54:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:54:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 15:55:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 15:55:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:55:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:55:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:55:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:55:17 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:55:22 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:55:28 user nova-compute[73254]: INFO nova.compute.claims [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Claim successful on node user
Aug 14 15:55:28 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:55:28 user nova-compute[73254]: DEBUG nova.network.neutron [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:55:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:55:28 user nova-compute[73254]: DEBUG nova.compute.manager [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:55:29 user nova-compute[73254]: INFO nova.virt.block_device [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Booting with volume b15e5846-3a1b-4339-9fa1-821c415382f1 at /dev/vda
Aug 14 15:55:29 user nova-compute[73254]: DEBUG nova.policy [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1121a299350a43539a236db2eee5144f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f37aabc603240cfa2fe9c4ee4ec74e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG os_brick.utils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9655f90e-0ee2-4fd4-ab2d-6810306b52ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[391b5470-3a49-4e21-829d-a9b0ad65650d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[980ba4d1-c0be-4264-8a2e-1f37698f1f06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f42c0c-40e3-41d7-8fe3-b3e9fec183ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:55:29 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a697246b-9100-4b9f-a484-00f7e44624f0]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG os_brick.utils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updating existing volume attachment record: d40ce802-b091-4671-a5a6-32d9f16b89f2 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:55:29 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:30 user nova-compute[73254]: DEBUG nova.network.neutron [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Successfully created port: bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG nova.network.neutron [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Successfully updated port: bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquired lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG nova.network.neutron [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG nova.compute.manager [req-b8718537-06da-4bc8-8f67-e507cc3e7814 req-e12b7563-a252-4eda-9d63-32c00af231b5 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received event network-changed-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG nova.compute.manager [req-b8718537-06da-4bc8-8f67-e507cc3e7814 req-e12b7563-a252-4eda-9d63-32c00af231b5 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Refreshing instance network info cache due to event network-changed-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b8718537-06da-4bc8-8f67-e507cc3e7814 req-e12b7563-a252-4eda-9d63-32c00af231b5 service nova] Acquiring lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG nova.network.neutron [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG nova.network.neutron [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updating instance_info_cache with network_info: [{"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Releasing lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG nova.compute.manager [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Instance network_info: |[{"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b8718537-06da-4bc8-8f67-e507cc3e7814 req-e12b7563-a252-4eda-9d63-32c00af231b5 service nova] Acquired lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG nova.network.neutron [req-b8718537-06da-4bc8-8f67-e507cc3e7814 req-e12b7563-a252-4eda-9d63-32c00af231b5 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Refreshing network info cache for port bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG nova.network.neutron [req-b8718537-06da-4bc8-8f67-e507cc3e7814 req-e12b7563-a252-4eda-9d63-32c00af231b5 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updated VIF entry in instance network info cache for port bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG nova.network.neutron [req-b8718537-06da-4bc8-8f67-e507cc3e7814 req-e12b7563-a252-4eda-9d63-32c00af231b5 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updating instance_info_cache with network_info: [{"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:55:31 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-b8718537-06da-4bc8-8f67-e507cc3e7814 req-e12b7563-a252-4eda-9d63-32c00af231b5 service nova] Releasing lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:55:32 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.compute.manager [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:55:37 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Creating image(s)
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Ensure instance console log exists: /opt/stack/data/nova/instances/81efd1ee-aaab-4a98-9d34-a1e3c73df47f/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Start _get_guest_xml network_info=[{"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd40ce802-b091-4671-a5a6-32d9f16b89f2', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iImJFfPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '81efd1ee-aaab-4a98-9d34-a1e3c73df47f', 'attached_at': '', 'detached_at': '', 'volume_id': 'b15e5846-3a1b-4339-9fa1-821c415382f1', 'serial': 'b15e5846-3a1b-4339-9fa1-821c415382f1'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:55:37 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:55:37 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iImJFfPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:55:37 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:55:37 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:55:37 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:55:37 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82cebba-71fa-494e-9791-556cf8cbfb18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:55:37 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[958a3eee-d5df-40cf-8389-fc49c335a1b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1] added
Aug 14 15:55:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebabd52-80cd-4e26-a786-eaec92282fc3]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c44e4a-c58a-4bb7-84e0-dfec96e74dda]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iImJFfPn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iImJFfPn" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0bbe5c-842f-41f5-87ca-231c71ba1497]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iImJFfPn'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66c9abd-3c17-499c-8f80-a3c599237b70]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[494e254a-1d18-4664-8cc3-c75f0c8fb96b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:55:37 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 14 15:55:37 user nova-compute[73254]:  {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:55:37 user nova-compute[73254]: WARNING os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 14 15:55:37 user nova-compute[73254]: 
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d0417f-5c76-47e2-8316-2c1ee18fdf03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260]
Aug 14 15:55:37 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260] successful.
Aug 14 15:55:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e409ef-da0d-4de0-ba76-0ee4b89f8e22]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e50629-367f-4651-9db3-1aaa8b051356]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:55:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:55:37 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96a4fb8-39b4-47d3-9e32-412fde154b48]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:55:37 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iImJFfPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:55:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:55:38 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26437366662356434', 'path': '/dev/sdb'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:55:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437366662356434', 'path': '/dev/sdb'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:55:38 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1651424534',display_name='tempest-TestVolumeBootPattern-server-1651424534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1651424534',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJATuecSP8lZKZp1VGqwYzKyvpPEZ2TZhPL5o3D7c8SHr7s5NdPAi2VNOeMaM+wdM/dpFTOV4Z9S160u6kOMs4E8aXtwRQyV6Et31CEAxTOVWOeIQltG+hnu1knyenbapA==',key_name='tempest-TestVolumeBootPattern-388200609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-he0ys3t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:55:29Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=81efd1ee-aaab-4a98-9d34-a1e3c73df47f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:55:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:55:38 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfbdfe3-58') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:55:38 user nova-compute[73254]: DEBUG nova.objects.instance [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'pci_devices' on Instance uuid 81efd1ee-aaab-4a98-9d34-a1e3c73df47f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:55:39 user nova-compute[73254]:   <uuid>81efd1ee-aaab-4a98-9d34-a1e3c73df47f</uuid>
Aug 14 15:55:39 user nova-compute[73254]:   <name>instance-00000033</name>
Aug 14 15:55:39 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:55:39 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:55:39 user nova-compute[73254]:   <metadata>
Aug 14 15:55:39 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:55:39 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:55:39 user nova-compute[73254]:       <nova:name>tempest-TestVolumeBootPattern-server-1651424534</nova:name>
Aug 14 15:55:39 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:55:37</nova:creationTime>
Aug 14 15:55:39 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:55:39 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:55:39 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:55:39 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:55:39 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:55:39 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:55:39 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:55:39 user nova-compute[73254]:       <nova:owner>
Aug 14 15:55:39 user nova-compute[73254]:         <nova:user uuid="1121a299350a43539a236db2eee5144f">tempest-TestVolumeBootPattern-428038303-project-member</nova:user>
Aug 14 15:55:39 user nova-compute[73254]:         <nova:project uuid="2f37aabc603240cfa2fe9c4ee4ec74e8">tempest-TestVolumeBootPattern-428038303</nova:project>
Aug 14 15:55:39 user nova-compute[73254]:       </nova:owner>
Aug 14 15:55:39 user nova-compute[73254]:       <nova:ports>
Aug 14 15:55:39 user nova-compute[73254]:         <nova:port uuid="bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c">
Aug 14 15:55:39 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 14 15:55:39 user nova-compute[73254]:         </nova:port>
Aug 14 15:55:39 user nova-compute[73254]:       </nova:ports>
Aug 14 15:55:39 user nova-compute[73254]:     </nova:instance>
Aug 14 15:55:39 user nova-compute[73254]:   </metadata>
Aug 14 15:55:39 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:55:39 user nova-compute[73254]:     <system>
Aug 14 15:55:39 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:55:39 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:55:39 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:55:39 user nova-compute[73254]:       <entry name="serial">81efd1ee-aaab-4a98-9d34-a1e3c73df47f</entry>
Aug 14 15:55:39 user nova-compute[73254]:       <entry name="uuid">81efd1ee-aaab-4a98-9d34-a1e3c73df47f</entry>
Aug 14 15:55:39 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:55:39 user nova-compute[73254]:     </system>
Aug 14 15:55:39 user nova-compute[73254]:   </sysinfo>
Aug 14 15:55:39 user nova-compute[73254]:   <os>
Aug 14 15:55:39 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:55:39 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:55:39 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:55:39 user nova-compute[73254]:   </os>
Aug 14 15:55:39 user nova-compute[73254]:   <features>
Aug 14 15:55:39 user nova-compute[73254]:     <acpi/>
Aug 14 15:55:39 user nova-compute[73254]:     <apic/>
Aug 14 15:55:39 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:55:39 user nova-compute[73254]:   </features>
Aug 14 15:55:39 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:55:39 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:55:39 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:55:39 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:55:39 user nova-compute[73254]:   </clock>
Aug 14 15:55:39 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:55:39 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:55:39 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:55:39 user nova-compute[73254]:   </cpu>
Aug 14 15:55:39 user nova-compute[73254]:   <devices>
Aug 14 15:55:39 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:55:39 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:55:39 user nova-compute[73254]:       <source dev="/dev/sdb"/>
Aug 14 15:55:39 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:55:39 user nova-compute[73254]:       <serial>b15e5846-3a1b-4339-9fa1-821c415382f1</serial>
Aug 14 15:55:39 user nova-compute[73254]:     </disk>
Aug 14 15:55:39 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:55:39 user nova-compute[73254]:       <mac address="fa:16:3e:7b:db:0d"/>
Aug 14 15:55:39 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:55:39 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:55:39 user nova-compute[73254]:       <target dev="tapbbfbdfe3-58"/>
Aug 14 15:55:39 user nova-compute[73254]:     </interface>
Aug 14 15:55:39 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:55:39 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/81efd1ee-aaab-4a98-9d34-a1e3c73df47f/console.log" append="off"/>
Aug 14 15:55:39 user nova-compute[73254]:     </serial>
Aug 14 15:55:39 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:55:39 user nova-compute[73254]:     <video>
Aug 14 15:55:39 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:55:39 user nova-compute[73254]:     </video>
Aug 14 15:55:39 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:55:39 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:55:39 user nova-compute[73254]:     </rng>
Aug 14 15:55:39 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:55:39 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:55:39 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:55:39 user nova-compute[73254]:     </memballoon>
Aug 14 15:55:39 user nova-compute[73254]:   </devices>
Aug 14 15:55:39 user nova-compute[73254]: </domain>
Aug 14 15:55:39 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1651424534',display_name='tempest-TestVolumeBootPattern-server-1651424534',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1651424534',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJATuecSP8lZKZp1VGqwYzKyvpPEZ2TZhPL5o3D7c8SHr7s5NdPAi2VNOeMaM+wdM/dpFTOV4Z9S160u6kOMs4E8aXtwRQyV6Et31CEAxTOVWOeIQltG+hnu1knyenbapA==',key_name='tempest-TestVolumeBootPattern-388200609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-he0ys3t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:55:29Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=81efd1ee-aaab-4a98-9d34-a1e3c73df47f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfbdfe3-58') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG os_vif [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfbdfe3-58') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbfbdfe3-58, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbbfbdfe3-58, col_values=(('external_ids', {'iface-id': 'bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:db:0d', 'vm-uuid': '81efd1ee-aaab-4a98-9d34-a1e3c73df47f'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:39 user nova-compute[73254]: INFO os_vif [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfbdfe3-58')
Aug 14 15:55:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:55:39 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No VIF found with MAC fa:16:3e:7b:db:0d, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-6ad045d3-215b-4408-add0-ef939ec2bf76 req-f6491ce1-38ce-492d-b4c4-8e3fc74f8833 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received event network-vif-plugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6ad045d3-215b-4408-add0-ef939ec2bf76 req-f6491ce1-38ce-492d-b4c4-8e3fc74f8833 service nova] Acquiring lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6ad045d3-215b-4408-add0-ef939ec2bf76 req-f6491ce1-38ce-492d-b4c4-8e3fc74f8833 service nova] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6ad045d3-215b-4408-add0-ef939ec2bf76 req-f6491ce1-38ce-492d-b4c4-8e3fc74f8833 service nova] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG nova.compute.manager [req-6ad045d3-215b-4408-add0-ef939ec2bf76 req-f6491ce1-38ce-492d-b4c4-8e3fc74f8833 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] No waiting events found dispatching network-vif-plugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:55:40 user nova-compute[73254]: WARNING nova.compute.manager [req-6ad045d3-215b-4408-add0-ef939ec2bf76 req-f6491ce1-38ce-492d-b4c4-8e3fc74f8833 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received unexpected event network-vif-plugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c for instance with vm_state building and task_state spawning.
Aug 14 15:55:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692028542.4390922, 81efd1ee-aaab-4a98-9d34-a1e3c73df47f => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:55:42 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] VM Resumed (Lifecycle Event)
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:55:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Instance spawned successfully.
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:55:42 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692028542.4423268, 81efd1ee-aaab-4a98-9d34-a1e3c73df47f => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:55:42 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] VM Started (Lifecycle Event)
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:55:42 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-72f07b84-6d52-41da-83af-1cc6f4c311ed req-c00ba2a9-ffc1-4b96-9964-be2ad7db4d87 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received event network-vif-plugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72f07b84-6d52-41da-83af-1cc6f4c311ed req-c00ba2a9-ffc1-4b96-9964-be2ad7db4d87 service nova] Acquiring lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72f07b84-6d52-41da-83af-1cc6f4c311ed req-c00ba2a9-ffc1-4b96-9964-be2ad7db4d87 service nova] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-72f07b84-6d52-41da-83af-1cc6f4c311ed req-c00ba2a9-ffc1-4b96-9964-be2ad7db4d87 service nova] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.compute.manager [req-72f07b84-6d52-41da-83af-1cc6f4c311ed req-c00ba2a9-ffc1-4b96-9964-be2ad7db4d87 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] No waiting events found dispatching network-vif-plugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:55:42 user nova-compute[73254]: WARNING nova.compute.manager [req-72f07b84-6d52-41da-83af-1cc6f4c311ed req-c00ba2a9-ffc1-4b96-9964-be2ad7db4d87 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received unexpected event network-vif-plugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c for instance with vm_state building and task_state spawning.
Aug 14 15:55:42 user nova-compute[73254]: INFO nova.compute.manager [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 14 15:55:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:55:42 user nova-compute[73254]: INFO nova.compute.manager [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Took 14.02 seconds to build instance.
Aug 14 15:55:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-acb351db-62ff-478c-9263-a4e503b7f034 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.176s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:55:42 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:45 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:45 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:55:46 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:47 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:55:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:55:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:55:47 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:55:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:55:48 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:55:48 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:55:48 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=25.142696380615234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:55:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:55:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:55:48 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81efd1ee-aaab-4a98-9d34-a1e3c73df47f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:55:48 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:55:48 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:55:48 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:55:48 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:55:48 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:55:48 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 81efd1ee-aaab-4a98-9d34-a1e3c73df47f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updating instance_info_cache with network_info: [{"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:55:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:55:50 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:53 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:53 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:55:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:55:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:55:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:55:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:57 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:55:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:55:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:02 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_power_states {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:56:03 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Triggering sync for uuid 81efd1ee-aaab-4a98-9d34-a1e3c73df47f {{(pid=73254) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 14 15:56:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:56:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:56:03 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:56:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:07 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:12 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:56:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:56:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:56:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:56:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:56:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:56:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:56:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:56:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:56:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:56:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:56:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:56:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:46 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:56:46 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:56:46 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:56:49 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 81efd1ee-aaab-4a98-9d34-a1e3c73df47f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updating instance_info_cache with network_info: [{"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:56:50 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:56:50 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:56:50 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.14200210571289GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81efd1ee-aaab-4a98-9d34-a1e3c73df47f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:56:50 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:56:51 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 15:56:51 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 15:56:51 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 15:56:51 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 15:56:51 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 15:56:51 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:56:51 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:56:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:56:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:56:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:56:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:56:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:56:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:56:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:56:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:56:59 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:57:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:57:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:57:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:57:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:57:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:57:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:57:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:57:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:57:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:57:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:57:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:57:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:57:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:57:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-a52f6223-da36-42ca-879b-b45a02407d84 req-497e9251-7fb4-4d5e-a015-b960db905ef0 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received event network-changed-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:57:20 user nova-compute[73254]: DEBUG nova.compute.manager [req-a52f6223-da36-42ca-879b-b45a02407d84 req-497e9251-7fb4-4d5e-a015-b960db905ef0 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Refreshing instance network info cache due to event network-changed-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:57:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a52f6223-da36-42ca-879b-b45a02407d84 req-497e9251-7fb4-4d5e-a015-b960db905ef0 service nova] Acquiring lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:57:20 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a52f6223-da36-42ca-879b-b45a02407d84 req-497e9251-7fb4-4d5e-a015-b960db905ef0 service nova] Acquired lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:57:20 user nova-compute[73254]: DEBUG nova.network.neutron [req-a52f6223-da36-42ca-879b-b45a02407d84 req-497e9251-7fb4-4d5e-a015-b960db905ef0 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Refreshing network info cache for port bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:57:21 user nova-compute[73254]: DEBUG nova.network.neutron [req-a52f6223-da36-42ca-879b-b45a02407d84 req-497e9251-7fb4-4d5e-a015-b960db905ef0 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updated VIF entry in instance network info cache for port bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:57:21 user nova-compute[73254]: DEBUG nova.network.neutron [req-a52f6223-da36-42ca-879b-b45a02407d84 req-497e9251-7fb4-4d5e-a015-b960db905ef0 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updating instance_info_cache with network_info: [{"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:57:21 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-a52f6223-da36-42ca-879b-b45a02407d84 req-497e9251-7fb4-4d5e-a015-b960db905ef0 service nova] Releasing lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:57:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "4274675d-8f4d-41b8-b056-07c72a16684a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:57:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "4274675d-8f4d-41b8-b056-07c72a16684a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:57:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Starting instance... {{(pid=73254) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 14 15:57:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:57:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:57:33 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73254) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 14 15:57:33 user nova-compute[73254]: INFO nova.compute.claims [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Claim successful on node user
Aug 14 15:57:33 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:57:33 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:57:33 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.276s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:57:33 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Start building networks asynchronously for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Allocating IP information in the background. {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] allocate_for_instance() {{(pid=73254) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 14 15:57:34 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 14 15:57:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Start building block device mappings for instance. {{(pid=73254) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 14 15:57:34 user nova-compute[73254]: INFO nova.virt.block_device [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Booting with volume bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 at /dev/vda
Aug 14 15:57:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG nova.policy [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1121a299350a43539a236db2eee5144f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f37aabc603240cfa2fe9c4ee4ec74e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73254) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG os_brick.utils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b2f2b1-d525-4fc2-a0a1-d7349e369224]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:33e4fd5292f4\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4d6758-a277-4f57-b786-a476855f58a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddada54e-af34-4910-bdc8-d702e7d073a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fbc632-45a9-4639-95a2-57cefc3b605b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Running cmd (subprocess): nvme version {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] 'nvme version' failed. Not Retrying. {{(pid=73254) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] nvme not present on system {{(pid=73254) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 14 15:57:34 user nova-compute[73254]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 14 15:57:34 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c27fa9-849b-4b12-945f-9204bf1f4679]: (4, '') {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73254) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.lightos [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] LIGHTOS: no hostnqn found. {{(pid=73254) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG os_brick.utils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:33e4fd5292f4', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG nova.virt.block_device [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updating existing volume attachment record: f6aa3bee-f9f5-4c20-ad02-46a89d921455 {{(pid=73254) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 14 15:57:34 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Successfully created port: bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 14 15:57:35 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Successfully updated port: bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 14 15:57:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:57:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquired lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:57:35 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Building network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 14 15:57:35 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Instance cache missing network info. {{(pid=73254) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 14 15:57:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-76e49766-396a-4e94-ad57-ad2ba1207f73 req-9b7f32d8-a141-4516-bf45-0da3c18041e9 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received event network-changed-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:57:35 user nova-compute[73254]: DEBUG nova.compute.manager [req-76e49766-396a-4e94-ad57-ad2ba1207f73 req-9b7f32d8-a141-4516-bf45-0da3c18041e9 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Refreshing instance network info cache due to event network-changed-bb4129b0-9239-4e89-abef-a5b27de77200. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:57:35 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-76e49766-396a-4e94-ad57-ad2ba1207f73 req-9b7f32d8-a141-4516-bf45-0da3c18041e9 service nova] Acquiring lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:57:36 user nova-compute[73254]: DEBUG nova.network.neutron [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updating instance_info_cache with network_info: [{"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:57:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Releasing lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:57:36 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Instance network_info: |[{"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73254) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 14 15:57:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-76e49766-396a-4e94-ad57-ad2ba1207f73 req-9b7f32d8-a141-4516-bf45-0da3c18041e9 service nova] Acquired lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:57:36 user nova-compute[73254]: DEBUG nova.network.neutron [req-76e49766-396a-4e94-ad57-ad2ba1207f73 req-9b7f32d8-a141-4516-bf45-0da3c18041e9 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Refreshing network info cache for port bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:57:36 user nova-compute[73254]: DEBUG nova.network.neutron [req-76e49766-396a-4e94-ad57-ad2ba1207f73 req-9b7f32d8-a141-4516-bf45-0da3c18041e9 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updated VIF entry in instance network info cache for port bb4129b0-9239-4e89-abef-a5b27de77200. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:57:36 user nova-compute[73254]: DEBUG nova.network.neutron [req-76e49766-396a-4e94-ad57-ad2ba1207f73 req-9b7f32d8-a141-4516-bf45-0da3c18041e9 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updating instance_info_cache with network_info: [{"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:57:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-76e49766-396a-4e94-ad57-ad2ba1207f73 req-9b7f32d8-a141-4516-bf45-0da3c18041e9 service nova] Releasing lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:57:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Start spawning the instance on the hypervisor. {{(pid=73254) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Creating instance directory {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 14 15:57:42 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Creating image(s)
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Did not create local disks {{(pid=73254) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Ensure instance console log exists: /opt/stack/data/nova/instances/4274675d-8f4d-41b8-b056-07c72a16684a/console.log {{(pid=73254) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Start _get_guest_xml network_info=[{"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f6aa3bee-f9f5-4c20-ad02-46a89d921455', 'disk_bus': 'virtio', 'boot_index': 0, 'delete_on_termination': False, 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JegAqKTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4274675d-8f4d-41b8-b056-07c72a16684a', 'attached_at': '', 'detached_at': '', 'volume_id': 'bab539f2-80e3-4ce9-ad09-e7249dbb8bd0', 'serial': 'bab539f2-80e3-4ce9-ad09-e7249dbb8bd0'}, 'device_type': 'disk', 'mount_device': '/dev/vda', 'volume_type': None} {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 14 15:57:42 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:57:42 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller missing on host. {{(pid=73254) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.host [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU controller found on host. {{(pid=73254) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73254) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-14T14:54:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image limits 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flavor pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Image pref 0:0:0 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73254) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Got 1 possible topologies {{(pid=73254) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.hardware [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73254) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Calling os-brick to attach iSCSI Volume {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JegAqKTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:57:42 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:57:42 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:57:42 user nova-compute[73254]: INFO os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0d2a25-829f-43f5-ae95-bf8054fa38db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 14 15:57:42 user nova-compute[73254]:  {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7b9579-a573-4173-86a6-acc93c8500fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0] added\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0] added
Aug 14 15:57:42 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dbadeca-a64f-487c-aad0-0d43ee21dfd6]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f651fd43-41d1-4131-8474-e6a14cdf7843]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JegAqKTU {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JegAqKTU" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d35d02f-e13e-4653-97b6-0c3e20614205]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JegAqKTU'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57cefa5-dcb1-4a6c-853d-5e7e0ea24cb5]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:57:42 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8451d5-af37-4ed1-b061-4e37cdfc6e19]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:57:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:57:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --login {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a30216-1117-4a4b-ab5b-cc3a18b1b1ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0, portal: 172.16.0.220,3260]
Aug 14 15:57:43 user nova-compute[73254]: Login to [iface: default, target: iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0, portal: 172.16.0.220,3260] successful.
Aug 14 15:57:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded6dfb1-7d9c-4f4d-8cbb-77b4ca326329]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[62864392-2d43-4413-b824-6dd46c416cde]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:57:43 user nova-compute[73254]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 (non-flash)
Aug 14 15:57:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:57:43 user nova-compute[73254]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 (non-flash)
Aug 14 15:57:43 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to 172.16.0.220:3260 {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=73254) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73254) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[775007b7-58fd-4e6b-b166-6dd036951d14]: (4, ('- - 0', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73254) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 14 15:57:43 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JegAqKTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73254) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23763316634366537', 'path': '/dev/sdc'} {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763316634366537', 'path': '/dev/sdc'} {{(pid=73254) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-756641019',display_name='tempest-TestVolumeBootPattern-server-756641019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-756641019',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJATuecSP8lZKZp1VGqwYzKyvpPEZ2TZhPL5o3D7c8SHr7s5NdPAi2VNOeMaM+wdM/dpFTOV4Z9S160u6kOMs4E8aXtwRQyV6Et31CEAxTOVWOeIQltG+hnu1knyenbapA==',key_name='tempest-TestVolumeBootPattern-388200609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-0fkstwhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:57:34Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=4274675d-8f4d-41b8-b056-07c72a16684a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73254) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:ea,bridge_name='br-int',has_traffic_filtering=True,id=bb4129b0-9239-4e89-abef-a5b27de77200,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb4129b0-92') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.objects.instance [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'pci_devices' on Instance uuid 4274675d-8f4d-41b8-b056-07c72a16684a {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] End _get_guest_xml xml=<domain type="kvm">
Aug 14 15:57:44 user nova-compute[73254]:   <uuid>4274675d-8f4d-41b8-b056-07c72a16684a</uuid>
Aug 14 15:57:44 user nova-compute[73254]:   <name>instance-00000034</name>
Aug 14 15:57:44 user nova-compute[73254]:   <memory>524288</memory>
Aug 14 15:57:44 user nova-compute[73254]:   <vcpu>1</vcpu>
Aug 14 15:57:44 user nova-compute[73254]:   <metadata>
Aug 14 15:57:44 user nova-compute[73254]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 14 15:57:44 user nova-compute[73254]:       <nova:package version="0.0.0"/>
Aug 14 15:57:44 user nova-compute[73254]:       <nova:name>tempest-TestVolumeBootPattern-server-756641019</nova:name>
Aug 14 15:57:44 user nova-compute[73254]:       <nova:creationTime>2023-08-14 15:57:42</nova:creationTime>
Aug 14 15:57:44 user nova-compute[73254]:       <nova:flavor name="m1.tiny">
Aug 14 15:57:44 user nova-compute[73254]:         <nova:memory>512</nova:memory>
Aug 14 15:57:44 user nova-compute[73254]:         <nova:disk>1</nova:disk>
Aug 14 15:57:44 user nova-compute[73254]:         <nova:swap>0</nova:swap>
Aug 14 15:57:44 user nova-compute[73254]:         <nova:ephemeral>0</nova:ephemeral>
Aug 14 15:57:44 user nova-compute[73254]:         <nova:vcpus>1</nova:vcpus>
Aug 14 15:57:44 user nova-compute[73254]:       </nova:flavor>
Aug 14 15:57:44 user nova-compute[73254]:       <nova:owner>
Aug 14 15:57:44 user nova-compute[73254]:         <nova:user uuid="1121a299350a43539a236db2eee5144f">tempest-TestVolumeBootPattern-428038303-project-member</nova:user>
Aug 14 15:57:44 user nova-compute[73254]:         <nova:project uuid="2f37aabc603240cfa2fe9c4ee4ec74e8">tempest-TestVolumeBootPattern-428038303</nova:project>
Aug 14 15:57:44 user nova-compute[73254]:       </nova:owner>
Aug 14 15:57:44 user nova-compute[73254]:       <nova:ports>
Aug 14 15:57:44 user nova-compute[73254]:         <nova:port uuid="bb4129b0-9239-4e89-abef-a5b27de77200">
Aug 14 15:57:44 user nova-compute[73254]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 14 15:57:44 user nova-compute[73254]:         </nova:port>
Aug 14 15:57:44 user nova-compute[73254]:       </nova:ports>
Aug 14 15:57:44 user nova-compute[73254]:     </nova:instance>
Aug 14 15:57:44 user nova-compute[73254]:   </metadata>
Aug 14 15:57:44 user nova-compute[73254]:   <sysinfo type="smbios">
Aug 14 15:57:44 user nova-compute[73254]:     <system>
Aug 14 15:57:44 user nova-compute[73254]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 14 15:57:44 user nova-compute[73254]:       <entry name="product">OpenStack Nova</entry>
Aug 14 15:57:44 user nova-compute[73254]:       <entry name="version">0.0.0</entry>
Aug 14 15:57:44 user nova-compute[73254]:       <entry name="serial">4274675d-8f4d-41b8-b056-07c72a16684a</entry>
Aug 14 15:57:44 user nova-compute[73254]:       <entry name="uuid">4274675d-8f4d-41b8-b056-07c72a16684a</entry>
Aug 14 15:57:44 user nova-compute[73254]:       <entry name="family">Virtual Machine</entry>
Aug 14 15:57:44 user nova-compute[73254]:     </system>
Aug 14 15:57:44 user nova-compute[73254]:   </sysinfo>
Aug 14 15:57:44 user nova-compute[73254]:   <os>
Aug 14 15:57:44 user nova-compute[73254]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 14 15:57:44 user nova-compute[73254]:     <boot dev="hd"/>
Aug 14 15:57:44 user nova-compute[73254]:     <smbios mode="sysinfo"/>
Aug 14 15:57:44 user nova-compute[73254]:   </os>
Aug 14 15:57:44 user nova-compute[73254]:   <features>
Aug 14 15:57:44 user nova-compute[73254]:     <acpi/>
Aug 14 15:57:44 user nova-compute[73254]:     <apic/>
Aug 14 15:57:44 user nova-compute[73254]:     <vmcoreinfo/>
Aug 14 15:57:44 user nova-compute[73254]:   </features>
Aug 14 15:57:44 user nova-compute[73254]:   <clock offset="utc">
Aug 14 15:57:44 user nova-compute[73254]:     <timer name="pit" tickpolicy="delay"/>
Aug 14 15:57:44 user nova-compute[73254]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 14 15:57:44 user nova-compute[73254]:     <timer name="hpet" present="no"/>
Aug 14 15:57:44 user nova-compute[73254]:   </clock>
Aug 14 15:57:44 user nova-compute[73254]:   <cpu mode="custom" match="exact">
Aug 14 15:57:44 user nova-compute[73254]:     <model>Nehalem</model>
Aug 14 15:57:44 user nova-compute[73254]:     <topology sockets="1" cores="1" threads="1"/>
Aug 14 15:57:44 user nova-compute[73254]:   </cpu>
Aug 14 15:57:44 user nova-compute[73254]:   <devices>
Aug 14 15:57:44 user nova-compute[73254]:     <disk type="block" device="disk">
Aug 14 15:57:44 user nova-compute[73254]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 14 15:57:44 user nova-compute[73254]:       <source dev="/dev/sdc"/>
Aug 14 15:57:44 user nova-compute[73254]:       <target dev="vda" bus="virtio"/>
Aug 14 15:57:44 user nova-compute[73254]:       <serial>bab539f2-80e3-4ce9-ad09-e7249dbb8bd0</serial>
Aug 14 15:57:44 user nova-compute[73254]:     </disk>
Aug 14 15:57:44 user nova-compute[73254]:     <interface type="ethernet">
Aug 14 15:57:44 user nova-compute[73254]:       <mac address="fa:16:3e:40:72:ea"/>
Aug 14 15:57:44 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:57:44 user nova-compute[73254]:       <mtu size="1442"/>
Aug 14 15:57:44 user nova-compute[73254]:       <target dev="tapbb4129b0-92"/>
Aug 14 15:57:44 user nova-compute[73254]:     </interface>
Aug 14 15:57:44 user nova-compute[73254]:     <serial type="pty">
Aug 14 15:57:44 user nova-compute[73254]:       <log file="/opt/stack/data/nova/instances/4274675d-8f4d-41b8-b056-07c72a16684a/console.log" append="off"/>
Aug 14 15:57:44 user nova-compute[73254]:     </serial>
Aug 14 15:57:44 user nova-compute[73254]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 14 15:57:44 user nova-compute[73254]:     <video>
Aug 14 15:57:44 user nova-compute[73254]:       <model type="virtio"/>
Aug 14 15:57:44 user nova-compute[73254]:     </video>
Aug 14 15:57:44 user nova-compute[73254]:     <rng model="virtio">
Aug 14 15:57:44 user nova-compute[73254]:       <backend model="random">/dev/urandom</backend>
Aug 14 15:57:44 user nova-compute[73254]:     </rng>
Aug 14 15:57:44 user nova-compute[73254]:     <controller type="usb" index="0" model="none"/>
Aug 14 15:57:44 user nova-compute[73254]:     <memballoon model="virtio">
Aug 14 15:57:44 user nova-compute[73254]:       <stats period="10"/>
Aug 14 15:57:44 user nova-compute[73254]:     </memballoon>
Aug 14 15:57:44 user nova-compute[73254]:   </devices>
Aug 14 15:57:44 user nova-compute[73254]: </domain>
Aug 14 15:57:44 user nova-compute[73254]:  {{(pid=73254) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-756641019',display_name='tempest-TestVolumeBootPattern-server-756641019',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-756641019',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJATuecSP8lZKZp1VGqwYzKyvpPEZ2TZhPL5o3D7c8SHr7s5NdPAi2VNOeMaM+wdM/dpFTOV4Z9S160u6kOMs4E8aXtwRQyV6Et31CEAxTOVWOeIQltG+hnu1knyenbapA==',key_name='tempest-TestVolumeBootPattern-388200609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-0fkstwhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-14T15:57:34Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=4274675d-8f4d-41b8-b056-07c72a16684a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:ea,bridge_name='br-int',has_traffic_filtering=True,id=bb4129b0-9239-4e89-abef-a5b27de77200,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb4129b0-92') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG os_vif [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:ea,bridge_name='br-int',has_traffic_filtering=True,id=bb4129b0-9239-4e89-abef-a5b27de77200,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb4129b0-92') {{(pid=73254) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb4129b0-92, may_exist=True, interface_attrs={}) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbb4129b0-92, col_values=(('external_ids', {'iface-id': 'bb4129b0-9239-4e89-abef-a5b27de77200', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:72:ea', 'vm-uuid': '4274675d-8f4d-41b8-b056-07c72a16684a'}),), if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:44 user nova-compute[73254]: INFO os_vif [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:72:ea,bridge_name='br-int',has_traffic_filtering=True,id=bb4129b0-9239-4e89-abef-a5b27de77200,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb4129b0-92')
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73254) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 14 15:57:44 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] No VIF found with MAC fa:16:3e:40:72:ea, not building metadata {{(pid=73254) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 14 15:57:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-67b56ac2-48fa-4cdb-aced-e8971a6588c2 req-19aa0a4d-7a44-434c-ae1e-2da3efebd229 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received event network-vif-plugged-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:57:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-67b56ac2-48fa-4cdb-aced-e8971a6588c2 req-19aa0a4d-7a44-434c-ae1e-2da3efebd229 service nova] Acquiring lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:57:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-67b56ac2-48fa-4cdb-aced-e8971a6588c2 req-19aa0a4d-7a44-434c-ae1e-2da3efebd229 service nova] Lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:57:45 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-67b56ac2-48fa-4cdb-aced-e8971a6588c2 req-19aa0a4d-7a44-434c-ae1e-2da3efebd229 service nova] Lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:57:45 user nova-compute[73254]: DEBUG nova.compute.manager [req-67b56ac2-48fa-4cdb-aced-e8971a6588c2 req-19aa0a4d-7a44-434c-ae1e-2da3efebd229 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] No waiting events found dispatching network-vif-plugged-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:57:45 user nova-compute[73254]: WARNING nova.compute.manager [req-67b56ac2-48fa-4cdb-aced-e8971a6588c2 req-19aa0a4d-7a44-434c-ae1e-2da3efebd229 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received unexpected event network-vif-plugged-bb4129b0-9239-4e89-abef-a5b27de77200 for instance with vm_state building and task_state spawning.
Aug 14 15:57:46 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692028667.6425476, 4274675d-8f4d-41b8-b056-07c72a16684a => Resumed> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:57:47 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] VM Resumed (Lifecycle Event)
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Instance event wait completed in 0 seconds for  {{(pid=73254) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Guest created on hypervisor {{(pid=73254) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 14 15:57:47 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Instance spawned successfully.
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Found default for hw_cdrom_bus of ide {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Found default for hw_disk_bus of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Found default for hw_input_bus of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Found default for hw_pointer_model of None {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Found default for hw_video_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Found default for hw_vif_model of virtio {{(pid=73254) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 14 15:57:47 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.virt.driver [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] Emitting event <LifecycleEvent: 1692028667.6439068, 4274675d-8f4d-41b8-b056-07c72a16684a => Started> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:57:47 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] VM Started (Lifecycle Event)
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73254) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 14 15:57:47 user nova-compute[73254]: INFO nova.compute.manager [None req-c3774201-ddd7-42f2-a195-1629d5f0570d None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 14 15:57:47 user nova-compute[73254]: INFO nova.compute.manager [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.compute.manager [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:57:47 user nova-compute[73254]: INFO nova.compute.manager [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Took 14.18 seconds to build instance.
Aug 14 15:57:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-f8e3b48a-f13d-4854-8213-3753ba83d435 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "4274675d-8f4d-41b8-b056-07c72a16684a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.305s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-e93a73a5-681a-4b1c-b96e-dfa798a39890 req-1182d8b8-bb8c-47ee-84b9-810cfeb32dad service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received event network-vif-plugged-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e93a73a5-681a-4b1c-b96e-dfa798a39890 req-1182d8b8-bb8c-47ee-84b9-810cfeb32dad service nova] Acquiring lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e93a73a5-681a-4b1c-b96e-dfa798a39890 req-1182d8b8-bb8c-47ee-84b9-810cfeb32dad service nova] Lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e93a73a5-681a-4b1c-b96e-dfa798a39890 req-1182d8b8-bb8c-47ee-84b9-810cfeb32dad service nova] Lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:57:47 user nova-compute[73254]: DEBUG nova.compute.manager [req-e93a73a5-681a-4b1c-b96e-dfa798a39890 req-1182d8b8-bb8c-47ee-84b9-810cfeb32dad service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] No waiting events found dispatching network-vif-plugged-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:57:47 user nova-compute[73254]: WARNING nova.compute.manager [req-e93a73a5-681a-4b1c-b96e-dfa798a39890 req-1182d8b8-bb8c-47ee-84b9-810cfeb32dad service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received unexpected event network-vif-plugged-bb4129b0-9239-4e89-abef-a5b27de77200 for instance with vm_state active and task_state None.
Aug 14 15:57:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:50 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:57:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:57:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:57:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:57:50 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:57:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:57:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:57:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:57:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:57:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8707MB free_disk=25.140148162841797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:57:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:57:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:57:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81efd1ee-aaab-4a98-9d34-a1e3c73df47f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:57:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 4274675d-8f4d-41b8-b056-07c72a16684a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:57:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:57:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:57:51 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:57:51 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:57:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:57:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:57:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:57:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:57:52 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:57:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:57:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:57:52 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:57:52 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 81efd1ee-aaab-4a98-9d34-a1e3c73df47f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:57:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:53 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updating instance_info_cache with network_info: [{"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:57:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:57:53 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:57:53 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:57:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:57:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:57:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:57:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:00 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:58:01 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:58:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:29 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:58:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:58:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:58:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:39 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:58:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:58:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:58:44 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:58:46 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:58:49 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:58:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:58:50 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:58:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:58:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:58:50 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:58:50 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:58:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:58:50 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:58:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:58:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:58:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=25.139434814453125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:58:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:58:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:58:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81efd1ee-aaab-4a98-9d34-a1e3c73df47f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:58:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 4274675d-8f4d-41b8-b056-07c72a16684a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:58:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:58:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:58:51 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:58:51 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:58:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:58:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.197s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updating instance_info_cache with network_info: [{"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:58:54 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:58:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:58:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:58:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:58:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:58:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:58:59 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:59:00 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:00 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:01 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:04 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:59:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:59:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:59:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:59:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:59:09 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:59:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:59:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 15:59:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:59:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 15:59:14 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:19 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:59:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:24 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-6817a4e1-6ef5-4d81-881f-d2f93f90d7a6 req-32b31b6e-5640-43ce-8571-aba3049ae603 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received event network-changed-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:59:25 user nova-compute[73254]: DEBUG nova.compute.manager [req-6817a4e1-6ef5-4d81-881f-d2f93f90d7a6 req-32b31b6e-5640-43ce-8571-aba3049ae603 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Refreshing instance network info cache due to event network-changed-bb4129b0-9239-4e89-abef-a5b27de77200. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:59:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6817a4e1-6ef5-4d81-881f-d2f93f90d7a6 req-32b31b6e-5640-43ce-8571-aba3049ae603 service nova] Acquiring lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:59:25 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6817a4e1-6ef5-4d81-881f-d2f93f90d7a6 req-32b31b6e-5640-43ce-8571-aba3049ae603 service nova] Acquired lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:59:25 user nova-compute[73254]: DEBUG nova.network.neutron [req-6817a4e1-6ef5-4d81-881f-d2f93f90d7a6 req-32b31b6e-5640-43ce-8571-aba3049ae603 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Refreshing network info cache for port bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:59:26 user nova-compute[73254]: DEBUG nova.network.neutron [req-6817a4e1-6ef5-4d81-881f-d2f93f90d7a6 req-32b31b6e-5640-43ce-8571-aba3049ae603 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updated VIF entry in instance network info cache for port bb4129b0-9239-4e89-abef-a5b27de77200. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:59:26 user nova-compute[73254]: DEBUG nova.network.neutron [req-6817a4e1-6ef5-4d81-881f-d2f93f90d7a6 req-32b31b6e-5640-43ce-8571-aba3049ae603 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updating instance_info_cache with network_info: [{"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:59:26 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-6817a4e1-6ef5-4d81-881f-d2f93f90d7a6 req-32b31b6e-5640-43ce-8571-aba3049ae603 service nova] Releasing lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-7948a2a4-5ab0-4a7b-a543-bec9dcdd4b2d req-5cee84b7-597a-478b-a303-867b93b2c2aa service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received event network-changed-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-7948a2a4-5ab0-4a7b-a543-bec9dcdd4b2d req-5cee84b7-597a-478b-a303-867b93b2c2aa service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Refreshing instance network info cache due to event network-changed-bb4129b0-9239-4e89-abef-a5b27de77200. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7948a2a4-5ab0-4a7b-a543-bec9dcdd4b2d req-5cee84b7-597a-478b-a303-867b93b2c2aa service nova] Acquiring lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7948a2a4-5ab0-4a7b-a543-bec9dcdd4b2d req-5cee84b7-597a-478b-a303-867b93b2c2aa service nova] Acquired lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG nova.network.neutron [req-7948a2a4-5ab0-4a7b-a543-bec9dcdd4b2d req-5cee84b7-597a-478b-a303-867b93b2c2aa service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Refreshing network info cache for port bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "4274675d-8f4d-41b8-b056-07c72a16684a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "4274675d-8f4d-41b8-b056-07c72a16684a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:59:27 user nova-compute[73254]: INFO nova.compute.manager [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Terminating instance
Aug 14 15:59:27 user nova-compute[73254]: DEBUG nova.compute.manager [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-27381ef1-5f6d-4453-a775-07c763a253cb req-565711c3-8a96-4058-b0e8-a7b58ee628c2 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received event network-vif-unplugged-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-27381ef1-5f6d-4453-a775-07c763a253cb req-565711c3-8a96-4058-b0e8-a7b58ee628c2 service nova] Acquiring lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-27381ef1-5f6d-4453-a775-07c763a253cb req-565711c3-8a96-4058-b0e8-a7b58ee628c2 service nova] Lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-27381ef1-5f6d-4453-a775-07c763a253cb req-565711c3-8a96-4058-b0e8-a7b58ee628c2 service nova] Lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-27381ef1-5f6d-4453-a775-07c763a253cb req-565711c3-8a96-4058-b0e8-a7b58ee628c2 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] No waiting events found dispatching network-vif-unplugged-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:59:27 user nova-compute[73254]: DEBUG nova.compute.manager [req-27381ef1-5f6d-4453-a775-07c763a253cb req-565711c3-8a96-4058-b0e8-a7b58ee628c2 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received event network-vif-unplugged-bb4129b0-9239-4e89-abef-a5b27de77200 for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 15:59:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Instance destroyed successfully.
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.objects.instance [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'resources' on Instance uuid 4274675d-8f4d-41b8-b056-07c72a16684a {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:57:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-756641019',display_name='tempest-TestVolumeBootPattern-server-756641019',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-756641019',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJATuecSP8lZKZp1VGqwYzKyvpPEZ2TZhPL5o3D7c8SHr7s5NdPAi2VNOeMaM+wdM/dpFTOV4Z9S160u6kOMs4E8aXtwRQyV6Et31CEAxTOVWOeIQltG+hnu1knyenbapA==',key_name='tempest-TestVolumeBootPattern-388200609',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:57:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-0fkstwhv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:57:48Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=4274675d-8f4d-41b8-b056-07c72a16684a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.221", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:72:ea,bridge_name='br-int',has_traffic_filtering=True,id=bb4129b0-9239-4e89-abef-a5b27de77200,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb4129b0-92') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_vif [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:72:ea,bridge_name='br-int',has_traffic_filtering=True,id=bb4129b0-9239-4e89-abef-a5b27de77200,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb4129b0-92') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb4129b0-92, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:59:28 user nova-compute[73254]: INFO os_vif [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:72:ea,bridge_name='br-int',has_traffic_filtering=True,id=bb4129b0-9239-4e89-abef-a5b27de77200,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb4129b0-92')
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JegAqKTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 15:59:28 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[11db0a6a-de9e-488a-a981-6063e2161f22]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54af792-e782-4e09-864d-dc4329b151c4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:59:28 user nova-compute[73254]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 (non-flash)
Aug 14 15:59:28 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 15:59:28 user nova-compute[73254]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 (non-flash)
Aug 14 15:59:28 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd648461ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0'): ({'sdc'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Removing single pathed devices sdc {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db90226-7f8d-40fb-b541-a9e13d890cc0]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[86354b23-25b5-45b1-94ab-20234ce04ead]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flushing IO for device /dev/sdc {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[28682cc0-96fc-479b-83e2-8abde1ef5623]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[821ffd27-12ee-4e2e-ac3c-2fdf85c89006]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] SCSI volumes sdc have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac0a65c-1ee6-42fe-bf06-afb5ca4500dd]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.network.neutron [req-7948a2a4-5ab0-4a7b-a543-bec9dcdd4b2d req-5cee84b7-597a-478b-a303-867b93b2c2aa service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updated VIF entry in instance network info cache for port bb4129b0-9239-4e89-abef-a5b27de77200. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.network.neutron [req-7948a2a4-5ab0-4a7b-a543-bec9dcdd4b2d req-5cee84b7-597a-478b-a303-867b93b2c2aa service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updating instance_info_cache with network_info: [{"id": "bb4129b0-9239-4e89-abef-a5b27de77200", "address": "fa:16:3e:40:72:ea", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4129b0-92", "ovs_interfaceid": "bb4129b0-9239-4e89-abef-a5b27de77200", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed97887-140b-4f42-9e00-984b3dbc02e0]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-7948a2a4-5ab0-4a7b-a543-bec9dcdd4b2d req-5cee84b7-597a-478b-a303-867b93b2c2aa service nova] Releasing lock "refresh_cache-4274675d-8f4d-41b8-b056-07c72a16684a" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0, portal: 172.16.0.220,3260]
Aug 14 15:59:28 user nova-compute[73254]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0, portal: 172.16.0.220,3260] successful.
Aug 14 15:59:28 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab539f2-80e3-4ce9-ad09-e7249dbb8bd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffc125a-40aa-49b3-8f38-0c8c63f82b03]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== disconnect_volume: return (290ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 15:59:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Deleting instance files /opt/stack/data/nova/instances/4274675d-8f4d-41b8-b056-07c72a16684a_del
Aug 14 15:59:28 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Deletion of /opt/stack/data/nova/instances/4274675d-8f4d-41b8-b056-07c72a16684a_del complete
Aug 14 15:59:28 user nova-compute[73254]: INFO nova.compute.manager [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 14 15:59:28 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:59:28 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Took 0.54 seconds to deallocate network for instance.
Aug 14 15:59:28 user nova-compute[73254]: DEBUG nova.compute.manager [req-3b3c6fdf-f845-48d2-a82f-f37c4c76ca19 req-a9991f63-6000-4295-85ef-0549ca6882da service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received event network-vif-deleted-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:59:29 user nova-compute[73254]: INFO nova.compute.manager [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Took 0.76 seconds to detach 1 volumes for instance.
Aug 14 15:59:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:59:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:59:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-e52e74c8-5088-419c-b1a9-249eb5e94c86 req-6102d125-a935-4262-b0dc-36fbe55fafe1 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received event network-vif-plugged-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 15:59:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e52e74c8-5088-419c-b1a9-249eb5e94c86 req-6102d125-a935-4262-b0dc-36fbe55fafe1 service nova] Acquiring lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:59:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e52e74c8-5088-419c-b1a9-249eb5e94c86 req-6102d125-a935-4262-b0dc-36fbe55fafe1 service nova] Lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:59:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e52e74c8-5088-419c-b1a9-249eb5e94c86 req-6102d125-a935-4262-b0dc-36fbe55fafe1 service nova] Lock "4274675d-8f4d-41b8-b056-07c72a16684a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:59:29 user nova-compute[73254]: DEBUG nova.compute.manager [req-e52e74c8-5088-419c-b1a9-249eb5e94c86 req-6102d125-a935-4262-b0dc-36fbe55fafe1 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] No waiting events found dispatching network-vif-plugged-bb4129b0-9239-4e89-abef-a5b27de77200 {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 15:59:29 user nova-compute[73254]: WARNING nova.compute.manager [req-e52e74c8-5088-419c-b1a9-249eb5e94c86 req-6102d125-a935-4262-b0dc-36fbe55fafe1 service nova] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Received unexpected event network-vif-plugged-bb4129b0-9239-4e89-abef-a5b27de77200 for instance with vm_state deleted and task_state None.
Aug 14 15:59:29 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:59:29 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:59:29 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:59:29 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Deleted allocations for instance 4274675d-8f4d-41b8-b056-07c72a16684a
Aug 14 15:59:30 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-08dee0ff-923a-456e-a4e5-16e2a3adedb5 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "4274675d-8f4d-41b8-b056-07c72a16684a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.739s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:59:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 15:59:43 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692028768.011111, 4274675d-8f4d-41b8-b056-07c72a16684a => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 15:59:43 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] VM Stopped (Lifecycle Event)
Aug 14 15:59:43 user nova-compute[73254]: DEBUG nova.compute.manager [None req-cf7de48a-ca17-46f7-897c-cb21cb7b1599 None None] [instance: 4274675d-8f4d-41b8-b056-07c72a16684a] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 15:59:43 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:59:47 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:48 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:59:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:49 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 15:59:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:59:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:59:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:59:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 15:59:51 user nova-compute[73254]: DEBUG nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73254) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 14 15:59:52 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:59:52 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 15:59:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8791MB free_disk=25.138572692871094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 15:59:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 15:59:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 15:59:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Instance 81efd1ee-aaab-4a98-9d34-a1e3c73df47f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73254) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 14 15:59:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 15:59:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 15:59:52 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 15:59:52 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 15:59:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 15:59:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.147s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 15:59:53 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquired lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Forcefully refreshing network info cache for instance {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG nova.objects.instance [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lazy-loading 'info_cache' on Instance uuid 81efd1ee-aaab-4a98-9d34-a1e3c73df47f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG nova.network.neutron [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updating instance_info_cache with network_info: [{"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Releasing lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updated the network info_cache for instance {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:56 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:57 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances with incomplete migration  {{(pid=73254) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 14 15:59:57 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 15:59:58 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:00:01 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:00:03 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:00:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:00:04 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:00:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Cleaning up deleted instances {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 14 16:00:04 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] There are 0 instances to clean {{(pid=73254) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 14 16:00:08 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:00:13 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:18 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:23 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:00:28 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:33 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-cc7850f9-66ba-4d92-9dae-d56285a9840c req-151b5dd2-1c71-4251-b675-c5d871149ec6 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received event network-changed-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-cc7850f9-66ba-4d92-9dae-d56285a9840c req-151b5dd2-1c71-4251-b675-c5d871149ec6 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Refreshing instance network info cache due to event network-changed-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c. {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cc7850f9-66ba-4d92-9dae-d56285a9840c req-151b5dd2-1c71-4251-b675-c5d871149ec6 service nova] Acquiring lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cc7850f9-66ba-4d92-9dae-d56285a9840c req-151b5dd2-1c71-4251-b675-c5d871149ec6 service nova] Acquired lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG nova.network.neutron [req-cc7850f9-66ba-4d92-9dae-d56285a9840c req-151b5dd2-1c71-4251-b675-c5d871149ec6 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Refreshing network info cache for port bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:00:34 user nova-compute[73254]: INFO nova.compute.manager [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Terminating instance
Aug 14 16:00:34 user nova-compute[73254]: DEBUG nova.compute.manager [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Start destroying the instance on the hypervisor. {{(pid=73254) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG nova.network.neutron [req-cc7850f9-66ba-4d92-9dae-d56285a9840c req-151b5dd2-1c71-4251-b675-c5d871149ec6 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updated VIF entry in instance network info cache for port bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c. {{(pid=73254) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG nova.network.neutron [req-cc7850f9-66ba-4d92-9dae-d56285a9840c req-151b5dd2-1c71-4251-b675-c5d871149ec6 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updating instance_info_cache with network_info: [{"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-48a4c12d-91e3-4c30-9c48-a0b96100920b req-93fd678b-2754-4349-956e-725ee4dab472 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received event network-vif-unplugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-48a4c12d-91e3-4c30-9c48-a0b96100920b req-93fd678b-2754-4349-956e-725ee4dab472 service nova] Acquiring lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-48a4c12d-91e3-4c30-9c48-a0b96100920b req-93fd678b-2754-4349-956e-725ee4dab472 service nova] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-48a4c12d-91e3-4c30-9c48-a0b96100920b req-93fd678b-2754-4349-956e-725ee4dab472 service nova] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-48a4c12d-91e3-4c30-9c48-a0b96100920b req-93fd678b-2754-4349-956e-725ee4dab472 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] No waiting events found dispatching network-vif-unplugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG nova.compute.manager [req-48a4c12d-91e3-4c30-9c48-a0b96100920b req-93fd678b-2754-4349-956e-725ee4dab472 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received event network-vif-unplugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c for instance with task_state deleting. {{(pid=73254) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 14 16:00:34 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-cc7850f9-66ba-4d92-9dae-d56285a9840c req-151b5dd2-1c71-4251-b675-c5d871149ec6 service nova] Releasing lock "refresh_cache-81efd1ee-aaab-4a98-9d34-a1e3c73df47f" {{(pid=73254) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 14 16:00:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [-] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Instance destroyed successfully.
Aug 14 16:00:35 user nova-compute[73254]: DEBUG nova.objects.instance [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lazy-loading 'resources' on Instance uuid 81efd1ee-aaab-4a98-9d34-a1e3c73df47f {{(pid=73254) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.vif [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-14T15:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1651424534',display_name='tempest-TestVolumeBootPattern-server-1651424534',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1651424534',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJATuecSP8lZKZp1VGqwYzKyvpPEZ2TZhPL5o3D7c8SHr7s5NdPAi2VNOeMaM+wdM/dpFTOV4Z9S160u6kOMs4E8aXtwRQyV6Et31CEAxTOVWOeIQltG+hnu1knyenbapA==',key_name='tempest-TestVolumeBootPattern-388200609',keypairs=<?>,launch_index=0,launched_at=2023-08-14T15:55:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f37aabc603240cfa2fe9c4ee4ec74e8',ramdisk_id='',reservation_id='r-he0ys3t4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-428038303',owner_user_name='tempest-TestVolumeBootPattern-428038303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-14T15:55:43Z,user_data=None,user_id='1121a299350a43539a236db2eee5144f',uuid=81efd1ee-aaab-4a98-9d34-a1e3c73df47f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converting VIF {"id": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "address": "fa:16:3e:7b:db:0d", "network": {"id": "0f8a6480-d217-4504-b336-1138953eccb5", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-664443125-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f37aabc603240cfa2fe9c4ee4ec74e8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbfbdfe3-58", "ovs_interfaceid": "bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG nova.network.os_vif_util [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfbdfe3-58') {{(pid=73254) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_vif [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfbdfe3-58') {{(pid=73254) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbfbdfe3-58, bridge=br-int, if_exists=True) {{(pid=73254) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:00:35 user nova-compute[73254]: INFO os_vif [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:db:0d,bridge_name='br-int',has_traffic_filtering=True,id=bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c,network=Network(0f8a6480-d217-4504-b336-1138953eccb5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbfbdfe3-58')
Aug 14 16:00:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] calling os-brick to detach iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd6684d8520>, {'target_iqns': ['iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iImJFfPn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 14 16:00:35 user nova-compute[73254]: WARNING os_brick.initiator.connectors.base [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1', 0)] {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e422b3e6-fc51-4a42-a60c-cee0736ea188]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[904fed40-4fa1-4301-a355-a6ce75c09f3b]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 16:00:35 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 (non-flash)
Aug 14 16:00:35 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd64859f760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1'): ({'sdb'}, set())}) {{(pid=73254) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Removing single pathed devices sdb {{(pid=73254) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[03378460-67d4-43b8-ada9-e8f8d6c36fee]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80b6dda-5756-42d0-a83d-1ccdbdea1a94]: (4, ('ok\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Flushing IO for device /dev/sdb {{(pid=73254) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e86091d-41e4-46fc-932b-cd6b3fef7fa2]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73254) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[88aa6d1a-4cd6-4cf5-9d5e-8b7838228187]: (4, ('1', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.linuxscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] SCSI volumes sdb have been removed. {{(pid=73254) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26437366662356434', '/dev/disk/by-id/scsi-1SCST_BIO4d2f057e-d76fb5d499314599', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4d2f057e') {{(pid=84090) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[52acaf52-d75a-4862-87bb-80dd3cda950e]: (4, None) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1')] {{(pid=73254) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccd3f06-925d-432c-8962-4cfd1bc63ea8]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --logout {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c85582-13f9-4387-8c14-f33480a7f63c]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260]
Aug 14 16:00:35 user nova-compute[73254]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1, portal: 172.16.0.220,3260] successful.
Aug 14 16:00:35 user nova-compute[73254]:  stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op delete {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b15e5846-3a1b-4339-9fa1-821c415382f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84090) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d97e61-d048-45ff-90bf-74830edac648]: (4, ('', '')) {{(pid=84090) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73254) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.base [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] <== disconnect_volume: return (272ms) None {{(pid=73254) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Disconnected iSCSI Volume {{(pid=73254) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 14 16:00:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Deleting instance files /opt/stack/data/nova/instances/81efd1ee-aaab-4a98-9d34-a1e3c73df47f_del
Aug 14 16:00:35 user nova-compute[73254]: INFO nova.virt.libvirt.driver [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Deletion of /opt/stack/data/nova/instances/81efd1ee-aaab-4a98-9d34-a1e3c73df47f_del complete
Aug 14 16:00:35 user nova-compute[73254]: INFO nova.compute.manager [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 14 16:00:35 user nova-compute[73254]: DEBUG oslo.service.loopingcall [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73254) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG nova.compute.manager [-] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Deallocating network for instance {{(pid=73254) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 14 16:00:35 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] deallocate_for_instance() {{(pid=73254) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 14 16:00:36 user nova-compute[73254]: DEBUG nova.network.neutron [-] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Updating instance_info_cache with network_info: [] {{(pid=73254) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 14 16:00:36 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Took 0.52 seconds to deallocate network for instance.
Aug 14 16:00:36 user nova-compute[73254]: DEBUG nova.compute.manager [req-516b54ab-c908-43bf-b259-dfdad166f475 req-8ac89253-1e12-4e5e-b17f-ddc17f2d8473 service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received event network-vif-deleted-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:00:36 user nova-compute[73254]: INFO nova.compute.manager [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Took 0.70 seconds to detach 1 volumes for instance.
Aug 14 16:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:00:36 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:00:36 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:00:36 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:00:37 user nova-compute[73254]: INFO nova.scheduler.client.report [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Deleted allocations for instance 81efd1ee-aaab-4a98-9d34-a1e3c73df47f
Aug 14 16:00:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-e1e9ef05-4f5e-4151-bbe8-45115a2398c8 req-c98e9695-781d-4dae-8d56-2e6185519b4b service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received event network-vif-plugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 14 16:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1e9ef05-4f5e-4151-bbe8-45115a2398c8 req-c98e9695-781d-4dae-8d56-2e6185519b4b service nova] Acquiring lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1e9ef05-4f5e-4151-bbe8-45115a2398c8 req-c98e9695-781d-4dae-8d56-2e6185519b4b service nova] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [req-e1e9ef05-4f5e-4151-bbe8-45115a2398c8 req-c98e9695-781d-4dae-8d56-2e6185519b4b service nova] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:00:37 user nova-compute[73254]: DEBUG nova.compute.manager [req-e1e9ef05-4f5e-4151-bbe8-45115a2398c8 req-c98e9695-781d-4dae-8d56-2e6185519b4b service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] No waiting events found dispatching network-vif-plugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c {{(pid=73254) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 14 16:00:37 user nova-compute[73254]: WARNING nova.compute.manager [req-e1e9ef05-4f5e-4151-bbe8-45115a2398c8 req-c98e9695-781d-4dae-8d56-2e6185519b4b service nova] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Received unexpected event network-vif-plugged-bbfbdfe3-58ea-46a3-998a-7dcef02e0c3c for instance with vm_state deleted and task_state None.
Aug 14 16:00:37 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-1e0fc9fd-74ee-4193-8369-79034559b991 tempest-TestVolumeBootPattern-428038303 tempest-TestVolumeBootPattern-428038303-project-member] Lock "81efd1ee-aaab-4a98-9d34-a1e3c73df47f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.607s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:00:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:48 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:00:50 user nova-compute[73254]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692028835.2505708, 81efd1ee-aaab-4a98-9d34-a1e3c73df47f => Stopped> {{(pid=73254) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 14 16:00:50 user nova-compute[73254]: INFO nova.compute.manager [-] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] VM Stopped (Lifecycle Event)
Aug 14 16:00:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-97288543-b1eb-48eb-b21d-53a02e8dc096 None None] [instance: 81efd1ee-aaab-4a98-9d34-a1e3c73df47f] Checking state {{(pid=73254) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 14 16:00:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:00:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 16:00:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:00:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:00:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:00:50 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:00:50 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:00:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:00:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:00:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:00:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:00:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:00:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:00:51 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:00:51 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=8909MB free_disk=25.137657165527344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:00:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:00:51 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:00:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:00:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:00:52 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:00:52 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:00:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:00:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:00:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:00:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:00:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:00:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:00:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:00:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 16:00:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:00:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:01:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:01:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73254) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 14 16:01:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:01:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73254) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 14 16:01:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:02 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:01:03 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:01:04 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:01:05 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 14 16:01:10 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:15 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:20 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:25 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:30 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:34 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:35 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:38 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:40 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:45 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:49 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:01:50 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:51 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:01:51 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73254) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 14 16:01:52 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager.update_available_resource {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:01:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:01:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:01:52 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:01:52 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Auditing locally available compute resources for user (node: user) {{(pid=73254) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 14 16:01:53 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:01:53 user nova-compute[73254]: WARNING nova.virt.libvirt.driver [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Hypervisor/Node resource view: name=user free_ram=9074MB free_disk=25.134078979492188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}] {{(pid=73254) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73254) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing inventories for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating ProviderTree inventory for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Updating inventory in ProviderTree for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing aggregate associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, aggregates: None {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Refreshing trait associations for resource provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_FDC,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_RESCUE_BFV {{(pid=73254) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.compute.provider_tree [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed in ProviderTree for provider: 18d9725d-e260-4cf1-bc72-a3b274e87bc7 {{(pid=73254) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.scheduler.client.report [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Inventory has not changed for provider 18d9725d-e260-4cf1-bc72-a3b274e87bc7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73254) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG nova.compute.resource_tracker [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Compute_service record updated for user:user {{(pid=73254) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 14 16:01:53 user nova-compute[73254]: DEBUG oslo_concurrency.lockutils [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=73254) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 14 16:01:55 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 14 16:01:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:01:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Starting heal instance info cache {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 14 16:01:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Rebuilding the list of instances to heal {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 14 16:01:58 user nova-compute[73254]: DEBUG nova.compute.manager [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Didn't find any instances for network info cache update. {{(pid=73254) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 14 16:01:58 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:01:59 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:01:59 user nova-compute[73254]: DEBUG oslo_service.periodic_task [None req-5d182dc5-95bb-4a40-9585-52de3bfdd13e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73254) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 14 16:02:00 user nova-compute[73254]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=73254) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}